Best  Available  Copy 


SOME  TECHNIQUES  FOR  THE  SYNTHESIS  OF 
NONLINEAR  SYSTEMS 

AUBREY  M.  BUSH 


TECHNICAL  REPORT  441 


.MARCH  25,  1966 


CLEARINGHOUSE 
FOR  FEDERAL  SCIENTIFIC  AND 
TECHNICAL  INFORMATION 


aartoowT 

Miorofl«b» 

~~ 

i!£j2JL 

/C-lvp 

jU 

/ 


MASSACHUSETTS  INSTITUTE  OF  TECHNOLOGY 
RESEARCH  LABORATORY  OF  ELECTRONICS 

CAMBRIDGE,  MASSACHUSETTS 


3.00H07C&OZ.3 


1 

•> 

*0 


The  Research  Laboratory  of  Electronics  is  an  interdepartmental 
laboratory  in  which  faculty  members  and  graduate  students  from 
numerous  academic  departments  conduct  research. 

The  research  reported  in  this  document  was  made  possible  in 
part  by  support  extended  the  Massachusetts  Institute  of  Tech¬ 
nology,  Research  Laboratory  of  Electronics,  by  the  JOINT  SERV¬ 
ICES  ELECTRONICS  PROGRAMS  (US.  Army,  U.S.  Navy,  and 
U.S.  Air  Force)  under  Contract  No.  DA36-039-AMC-03200(E) ; 
additional  support  was  received  from  the  National  Science  Founda¬ 
tion  (Grant  GP-2495),  the  National  Institutes  of  Health  (Grant 
MH-04737-05).  and  the  National  Aeronautics  and  Space  Adminis¬ 
tration  (Grant  NsG-496). 

Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose 
of  the  United  States  Government. 

Qualified  requesters  may  obtain  copies  of  this  report  from  DDC. 


MASSACHUSETTS  INSTITUTE  OF  TECHNOLOGY 


RESEARCH  LABORATORY  OF  ELECTRONICS 


Technical  Report  441  March  25.  1966 

r 


SOME  TECHNIQUES  FOR  THE  SYNTHESIS  OF  NONLINEAR  SYSTEMS 


Aubrey  M.  Bush 


Submitted  to  the  Department  of  Electrical  Engineering,  M.  I.  T. , 
May  14,  1965,  in  partial  fulfillment  of  the  requirements  for  the 
degree  of  Doctor  of  Science. 

(Manuscript  received  June  16,  1965) 


Abstract 

We  have  studied  some  techniques  for  the  synthesis  of  nonlinear  systems.  The  sys¬ 
tems  considered  here  are  those  that  can  be  characterized  by  a  finite  set  of  Volterra 
kernels.  The  approach  is  to  consider  the  kernels  one  at  a  time,  by  using  as  basic  ele¬ 
ments  in  the  synthesis  linear  systems  and  multipliers.  We  present  a  procedure  for 
testing  a  given  kernel  transform  to  determine  whether  or  not  the  kernel  can  be  realized 
exactly  with  a  finite  number  of  linear  systems  and  multipliers.  The  test  is  construc¬ 
tive.  If  it  is  possible  to  realize  the  kernel  exactly,  a  realization  is  given  by  the  test; 
if  it  is  not  possible  to  realize  the  complete  kernel  exactly,  but  is  possible  to  break  the 
kernel  up  into  several  lower  degree  components,  this  will  also  be  discovered  by  the 
test.  An  extension  to  nonlinear  systems  of  the  impulse-train  techniques  of  linear  sys¬ 
tem  theory  is  given.  We  develop  properties  of  sampling  in  nonlinear  systems,  in 
order  to  facilitate  the  use  of  digital  techniques  in  the  synthesis  of  nonlinear  systems. 
Bandlimiting  in  nonlinear  systems  is  discussed,  and  delay-line  models  for  bandlimited 
systems  are  given.  The  transform  analysis  of  nonlinear  sampled-data  systems  by 
means  of  the  multidimensional  z-transform  is  presented.  Computation  algorithms  for 
input-output  computations  are  given  for  direct  computation  from  the  multidimensional 
convolution  sum,  the  associated  partial-difference  equation,  and  a  decomposition  of  the 
nonlinear  sampled-data  system  into  linear  sampled-data  systems.  A  relationship 
between  time-variant  and  time-invariant  systems  is  presented,  in  which  time-variant 
systems  are  shown  to  be  related  to  time -invariant  systems  of  higher  degree.  This  en¬ 
ables  one  to  use  for  linear  time-variant  systems  the  properties  and  techniques  devel¬ 
oped  for  second-degree  time -invariant  systems.  A  note  on  the  multidimensional 
formulation  of  nonlinear  systems  from  the  differential  equation  point  of  view  is  given; 
it  is  seen  that  some  nonlinear  problems  in  one  dimension  can  be  mapped  into  a  linear 
problem  in  a  higher  dimensional  space. 
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I.  INTRODUCTION 


1.  1  BRIEF  HISTORICAL  SKETCH 

The  use  of  functions?  analysis  as  a  tool  for  the  study  of  nonlinear  systems  was  first 

conceived  by  the  late  Norbert  Wiener. 1  Following  his  work,  pioneering  efforts  toward 

the  engineering  application  of  the  theory  of  functional  analysis  in  the  representation  of 

2  3 

nonlinear  systems  were  made  by  H.  E.  Singleton,  and  A.  G.  Bose,  who  placed  the 
theory  on  a  firm  engineering  basis  for  both  discrete  and  continuous  systems.  Following 
a  series  of  lectures  at  the  Massachusetts  Institute  of  Technology  by  Professor  Wiener,4 
several  others,  among  them  M.  B.  Brillant,  D.  A.  George,  and  D.  A.  Chester, 
studied  the  theory  of  continuous  nonlinear  systems  through  the  use  of  the  Volterra  func- 

o 

tional  power  series  and  the  orthogonal  Wiener  G-functionals.  A.  D.  Hause,  George 
Zames,^  Martin  Schetzen, H.  !  V*n  'f'reea, **’ ^  and  D.  J.  Sakrkcn**  subsequently 
made  useful  applications  and  extensions  of  the  theory.  Several  others  have  contributed 
at  M.I.  T.  and  elsewhere. 

Functional  analysis  has  proved  to  be  a  useful  tool  in  the  study  of  a  wide  class  of  non¬ 
linear  systems.  It  does  not  provide  an  all-encompassing  theory;  however,  particularly 
when  compared  with  other  approaches  to  the  study  of  nonlinear  systems,  the  startling 
feature  of  the  theory  is  not  that  it  does  not  treat  all  systems,  but  rather  that  the  class  of 
systems  which  it  does  treat  is  so  very  broad. 

The  basic  equation  of  the  theory  is 

oo 

»<t>*hot  Z  S'"  •  Tn)  X(t-Tj)  .  .  .  X(t-Tn)  dfj.  .  .dTn,  (l) 

n*l 

where  x(t)  is  the  system  input  time  function,  and  y(t)  is  the  corresponding  output  time 
function.  The  family  of  kernels 

(hn^Tl . rn):  n=  0,  1,  2. . .}  (2) 

characterizes  the  system,  in  that  knowledge  of  these  kernels  provides  the  means  for 
determining  the  output  corresponding  to  a  given  input.  Discussion  of  the  scope  and 
properties  of  (1)  and  (2)  may  be  found  in  the  work  of  the  authors  cited  above. 

Methods  for  measuring  the  kernels  of  a  system  have  been  developed,  14,1®  and  others 
are  being  studied1^;  the  correlation  methods  have  been  verified  experimentally.*^ 

It  has  been  observed,  originally  by  Wiener,  that  the  nonlinear  system  of  (1)  can  be 
represented  as  a  linear  memory  section  and  a  nonlinear  no-memory  section,  followed  by 
amplification  and  summation.  This  representation  provides  a  basis  for  a  general  syn¬ 
thesis  procedure  for  the  class  of  nonlinear  systems  represented  by  (1).  It  is  based  on  the 
expansion  of  the  input  time  function  in  an  orthogonal  series,  with  nonlinear  no-memory 
operations  being  performed  on  the  coefficients  of  this  expansion.  Although  general  and 
very  powerful,  it  may  involve,  practically,  an  unreasonably  large  amount  of  equipment. 
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1.2  THE  SYNTHESIS  PROBLEM 


From  both  a  practical  and  a  theoretical  standpoint,  it  is  very  desirable  to  develop 
means  of  synthesizing  a  nonlinear  system  from  the  kernels  through  which  it  is  charac¬ 
terized.  The  development  of  some  procedures  for  the  synthesis  of  nonlinear  systems 
is  the  problem  toward  which  this  research  is  directed. 

Several  points  are  inherent  in  this  development  of  synthesis  procedures  for  nonlinear 
systems.  A  finite  set  of  kernels  must  be  adequate  for  the  representation  of  the  system 
for  the  inputs  of  interest.  The  kernels  must  be  at  least  approximately  realizable  with 
a  finite  number  of  components  selected  for  the  synthesis.  It  is  to  be  expected  that  some 
means  of  synthesis  may  force  the  abandonment  of  the  use  of  orthogonal  expansions  of  the 
input  time  function  and  some  of  the  symmetrical  properties  of  the  kernels,  both 
extremely  valuable  properties  in  the  analysis  of  systems.  Also,  synthesis  procedures 
as  general  as  that  suggested  by  Wiener  should  not  be  expected  to  be  efficient  for  the  same 
broad  class  of  systems;  restrictions  on  both  the  inputs  to  be  allowed  and  the  kernels 
should  be  expected  as  the  price  to  be  paid  in  development  of  synthesis  procedures. 

Little  prior  work  on  the  synthesis  of  nonlinear  systems,  other  than  the  orthogonal 

1  £ 

expansion  of  Wiener,  has  been  done.  Jordan  found  the  optimum  finite-term  orthogonal 

expansions  of  the  input  time  function.  Van  Trees' 1 1  algorithm  for  the  determination  of 

the  optimum  compensator  for  a  feedback  system  provides  a  solution  in  terms  of  the  ker- 

19 

nels  of  the  optimum  system.  A  thesis  at  Stanford  University  by  Ming  Lei  Liou,  and 
20 

work  by  Schetzen  are  recent  contributions.  Schetzen  characterized  those  second-  and 
third-degree  kernels  that  are  exactly  realizable  with  a  finite  number  of  linear  systems 
and  multipliers,  while  Liou  gives  a  procedure  for  the  recognition  of  some  simple  struc¬ 
tures  of  linear  systems  and  polynomial  nonlinear  no-memory  systems. 

1.3  THE  PRESENT  APPROACH 

We  consider  a  finite  family  of  kernels 

{hn(T  j, . . . ,  ) :  n=  0,  1,2,...,  Nj  (3) 

and  attempt  to  synthesize  a  system  characterized  by  these  kernels.  We  consider  the 
kernels  one  at  a  time  and  take  as  elementary  building  blocks  linear  systems  and  multi¬ 
pliers.  Any  linear  system  that  is  realizable  in  the  sense  that  its  unit  impulse  response, 
h(t),  is  zero  for  t  <  0  is  allowable.  After  synthesis  with  these  elements  is  achieved  for 
each  kernel  of  the  family,  simplification  can  be  attempted,  to  yield  a  resulting  system 
that  is  an  interconnection  involving  linear  systems  and  nonlinear  no- memory  systems 
whose  input-output  characteristic  is  given  by  a  polynomial.  We  also  consider  sampled 
systems,  and  the  approximation  of  continuous  systems  by  the  sampled  systems. 

In  Section  II,  the  characterization  and  synthesis  of  kernels  that  are  exactly  realizable 
wi‘h  a  finite  number  of  linear  systems  and  multipliers  is  given.  A  detailed  discussion 
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of  the  effects  of  sampling  in  nonlinear  systems  is  presented  in  Section  III.  Simulation 
of  continuous  systems  by  sampled  systems  is  discussed  in  Section  IV.  L*  Sections  V 
and  VI  a  multidimensional  Z-transform  analysis  for  nonlinear  sampled-data  systems  is 
developed  and  used  to  discuss  the  synthesis  of  nonlinear  sampled-data  systems.  An 
extension  to  nonlinear  systems  of  the  impulse-train  techniques  which  have  proved  to  be 
so  useful  for  linear  systems  is  discussed  in  Section  VII.  In  Section  VIII  we  present  some 
miscellaneous  results  that  have  been  by-products  of  research  into  the  synthesis  problem. 
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n.  KERNELS  REALIZABLE  EXACTLY  WITH  A  FINITE  NUMBER  OF 
UNEAR  SYSTEMS  AND  MULTIPLIERS 


Although,  as  demonstrated  by  Wiener,  it  is  possible  to  approximate  arbitraril 
closely  any  absolutely  integrable  kernel  with  a  finite  number  of  linear  systems  and  n< 
linear  no-memory  systems,  not  all  systems  representable  by  a  finite  set  of  Volterra 
kernels  can  be  realized  exactly  by  means  of  these  elements.  We  consider  kernels  of 

the  set 

(VT1 . Tn):n*0.1.2 . N} 

one  at  a  time.  Since  the  tests  developed  to  determine  whether  or  not  a  kernel  is  exac 
realizable  by  means  of  a  finite  number  of  linear  systems  and  multipliers  are  consiru< 
tive  tests,  we  shall  not  only  determine  whether  or  not  a  kernel  is  exactly  realizable,  i 
we  shall,  if  possible,  find  a  realization  for  the  kerne] .  In  the  event  that  some  portior 
of  a  kernel  is  exactly  realizable  but  the  remainder  is  not,  we  shall  discover  this  also, 
again  achieving  a  realization  of  as  much  of  the  kernel  as  possible. 

We  define  a  kernel  transform  pair  by  the  relations 


/  i  \n  C'n+J00  f'l+i00 

hn<T> . Tn'*fej)  _Jaj  . “n)e 


*lV"-+Vn 


Vi* 


ds , . . .  ds 

i  r 


n  +<»  /»  + 

Hn(Bl . *n)  =  J 


hn(V 


V  e 


“SlV* 


.-s  r 
n  n 


dr,. .  .d-r 
1  n 


2.  1  "CANONIC"  OR  BASIC  FORMS 

We  shall  develop  "canonic"  or  basic  forms  for  kernels  that  are  exactly  realiza 
with  a  finite  number  of  linear  systems  and  multipliers.  These  structures  are  no 
canonic  in  any  minimal  or  precise  mathematical  sense;  they  are,  however,  can 
onic  in  the  sense  that  any  realization  by  linear  systems  and  multipliers  can  be  pla< 
in  these  forms. 

Consider,  first,  a  second-degree  kernel  and  its  transform: 
h2(Ti*T2)  H2^S1,S2^' 

It  is  clear  that  the  most  general  second-degree  system  that  can  be  formed  with 
one  multiplier  is  as  shown  in  Fig.  1.  The  most  general  second-degree  system  thal 
can  be  formed  by  using  N  multipliers  is  shown  in  Fig.  2.  We  shall  find  it  convenic 
to  think  of  the  system  of  Fig.  1  as  a  canonic  form  for  second-degree  systems,  sin 
all  second-degree  systems  that  can  be  realized  exactly  by  means  of  a  finite  numbe 
of  linear  systems  and  multipliers  can  be  represented  as  a  sum  of  these  canoni' 
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Fig.  1.  Canonic  second-degree  system. 


Fig.  2.  Second-degree  system  with  N  multipliers. 


sections,  ss  in  Fig.  2. 

The  kernel  of  the  canonic  section  of  Fig.  1  in  terms  of  the  impulse  responses  k  (t). 

tt 

k^(t).  and  k£(t)  of  the  linear  systems  is 


h2(TrV  "  I  ka(Va)  kb(T2“<r)  kc(ff)  d<r 


(6) 


and  the  corresponding  kernel  transform  is 


W*2>  *  Ka(Sl)  K^)  Kc(s1+s2). 


(7) 


Then  for  the  system  of  Fig.  2,  we  have  the  kernel  and  kernel  transform 


g2(Tl,T2)  “ 


I 


“a/V'1  kb1<V'>  kc,,r>  d<r 


02(a1.s2l  - 


N 

l K.  <-i>  VV  w 

i«l  1  1  1 


(8) 

(9) 


If  a  given  kernel  or  kernel  transform  can  be  expressed  in  the  form  (8)  or  (9),  for  some 
N.  then  it  can  be  realized  with  at  most  N  multipliers;  otherwise  it  cannot  be  real¬ 
ized  exactly  with  a  finite  number  of  linear  systems  and  multipliers.  Examples  of  both 

20 

types  of  systems  are  given  by  Schetzen. 

Let  us  now  consider  higher  degree  systems.  It  is  clear  that  the  canonic  third-degree 
system  is  as  shown  in  Fig.  3.  It  contains  five  linear  systems  and  two  multipliers.  In 
Fig.  4  the  same  system  is  shown  with  the  second-degree  canonic  form  composed  of  ka<t), 
k^t),  and  kc (t)  and  one  of  the  multipliers  shown  explicitly.  The  kernel  and  the  kernel 
transform  of  this  canonic  section  are  given  by 


VwV  ■  W  kd(T3"<r2)  W  MwV  WW  d<rid<r2 

K3(s1.s2.s3)  »  K^Sj)  Kj^)  Kc(Sj+s2)  Kd(s3)  K^s 
or  by 

k3<T,.T2.T3)  »  J  ke(<r2)  kd(T3-«r2)  k^Tj-^,  t 2~«r2>  d<r2 


(10) 

(11) 


(12) 


K3(Sj,s2,s3)  =  K2(SjS2)  Kd(s3)  Ke(sj+s2+s3)«  (13) 

where  k^Tj.Tg)  is  the  kernel  of  the  second-degree  system  shown  explicitly  in  Fig.  4. 

If  a  third-degree  system  has  a  kernel  transform  HjfSj.s^s^  which  can  be 
expressed  as 
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(14) 


H3«V82’83>  "  Z  V 
i«l  1 


)  Kb  («2l  Kc  (VV  *W  Ke  <8l+82+83> 


for  some  N,  then  it  can  be  realized  exactly  with  at  most  2N  multipliers.  If  it  cannot  be 
expressed  in  this  form,  then  it  is  impossible  to  realize  the  system  exactly  with  a  finite 
number  of  linear  systems  and  multipliers. 

Now  for  the  fourth-degree  systems  the  situation  is  somewhat  more  complicated.  Con¬ 
sider  the  systems  of  Fig.  5  and  Fig.  6.  Each  of  them  represents  a  fourth-degree  system 


Fig.  3.  Canonic  third-degree  system. 


Fig.  4.  Alternative  form  for  the  canonic  third-degree  system. 

and  each  of  them  is  composed  of  seven  linear  systems  and  three  multipliers,  but  the  two 
forms  are  essentially  different;  that  is,  no  block  diagram  manipulations  can  reduce  one 
of  these  forms  to  the  other.  Hence,  for  fourth-degree  systems,  we  have  two  canonic 
sections.  It  is  clear  that  any  fourth-degree  system  that  can  be  realized  with  three  or 


7 


8 


lesa  multiplier,  can  be  arranged  Into  one  of  these  canonic  forme.  For  example,  the 
fourth-degree  system  shown  in  Fig.  7  can  be  placed  in  the  form  of  the  section  of  Fig.  6. 
The  kernel  and  kernel  transforms  for  the  canonic  form  of  Fig.  5  are  given  by 

k41<TrVT3'T4>  *  JlfW  VW  ke(»2>  kd(T3-»2-,3,  k.!.,)  VVWV 

k.(T1-v|-v2-v3)  dv]dv2d»3  (15) 

•VVWV  *  W  Kt,<Sg)  WV  Kd(s3)  Ke(s1+s2ts3)  K{<8j 
or  (16) 

“dl'VWV  *  I  V'3»  VVV  k3<VV  W  V"3>  d’j  07) 

K41  (VWV  *  WW  K£(s4>  Kg<8l+82+83+S4>*  08) 

where  is  the  kernel  of  the  third-degree  section  within  the  fourth-degree 

section.  K 

For  the  canonic  form  of  Fig.  6,  the  kernel  and  kernel  transform  are  given  by 

k42<VVVT4>  ■  jlf V»3>  W  W  ka(VV'3>  VWV  kd<VVV 

VWV  d,rid,r2d<r3  <I9> 

K42(VV*3-*4>  .  Ka(Sl)  K^)  Kc(s1+s2)  Kd(s3)  KJsJ  KJ*^**^) 

or  (20) 

k42<Tl'T2*T3'T4,8Iv<r3)  k21(Tr<r3'V‘r3)  d<r3  (21) 

K42(8l<82'a3'84)  =  K21(8l'82)  K22(s3'84)  Kg(W  W*  (22) 

where  k  (Tj.^)  and  ^(t^)  represents  the  second-degree  canonic  section  within 
the  fourth-degree  canonic  section  above. 

..  “  *  giV'n  ,‘>Ur‘h'de8ree  ByB,em  is  characterized  by  a  kernel  transform  H.(s.,s,.s,.sJ 
which  car.  be  expressed  as  4  1  2  3  4' 

H4(V  WV  *  Z  “dl/WW  ♦  f  K ^1.,,^)  (23) 

for  some  N,  and  Nj,  then  the  system  can  be  realized  exactly  with  at  most  3W.MU 

Zoo^'h,"',  “  “I!  k'rnd  tranS,°rm  Can"0,  b'  aapcessed  in  the  form  of  (23).  then  it  is 
impossible  to  realize  the  system  exactly  with  a  finite  number  of  multipliers 

For  higher  degree  systems  we  shall  have  more  canonic  sections.  A  fifth-deeree  svs- 

em  may  be  formed  as  die  product  of  a  fourth-degree  and  a  fir. .-degree  system,  and  the 

fourth-degree  system  may  be  obtained  in  either  of  the  two  form,  given  above,  or  we  may 
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8.1 


(•)  Tree  for  a  fifth-degree  system 


3>3 

(b)  Tree  for  a  sixth-degree  syataa 


Fig.  8. 

Trees  showing  canonic  structures. 


obtain  the  fifth-degree  system  as  the  product  of  a  third-degree  system  and  a  second- 
degree  system.  A  sixth-degree  system  may  be  obtained  as  the  product  of  a  fifth- 
degree  system  and  a  first-degree  system,  a  fourth-degree  system  and  a  second-degree 
system,  or  a  third-degree  system  and  a  third-degree  system,  with  all  possible  forms 
for  each. 

Although  this  nomenclature  of  canonic  forms  rapidly  becomes  complex  as  the  degree 
of  the  system  is  increased,  we  may  use  the  concept  of  a  tree  to  summarize  the  process 
concisely,  and  to  arrive  at  an  expression  for  the  number  of  different  canonic  sections 
existing  for  an  n^-degree  system.  The  trees  for  the  fifth-degree  and  the  sixth-degree 
cases  are  shown  in  Fig.  8, 

To  form  the  tree  for,  say,  the  fifth-degree  system,  we  proceed  from  right  to  left.  A 
fifth-degree  system  may  be  formed  from  the  product  of  a  fourth-degree  system  and  a 
first-degree  system,  or  from  the  product  of  a  third-degree  system  and  a  second-degree 
system;  we  need,  in  moving  to  the  next  level  of  the  tree,  consider  only  the  fourth-degree, 
third-degree,  and  second-degree  systems.  The  third-degree  and  second-degree  systems 
have  only  one  canonic  section;  hence  the  tree  branch  corresponding  to  this  product  termi¬ 
nates  there.  The  fourth-degree  system  must  be  broken  down  further,  and  hence  this 
branch  of  the  tree  continues,  spreading  out  still  further,  until  a  level  at  which  only  one 
canonic  section  exists  is  reached. 
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A  complication  arises  in  the  tree  for  the  eighth-degree  case,  Fig.  9.  Here  we  find 
a  branch  corresponding  to  a  product  of  two  fourth-degree  systems;  at  this  point  we  must 
expand  the  tree  in  both  directions  until  we  arrive  at  branches  having  only  one  canonic 
section,  as  shown  in  Fig.  9. 

iL 

We  may  now  observe  that  the  number  of  different  canonic  sections,  C(n),  for  an  n  - 
degree  system  is  obtained  from  the  expression 


fn/2] 

C(n)  =  £  C(n-k)  C(k). 
k=l 


n^2 


(24) 


C(I)  =  1, 


where  [•]  denotes  the  greatest  integer  function.  For  example,  the  number  of  canonic 
sections  for  a  =  7  is  given  by  (24)  as 


C(7)  =  C(6)  C(l)  +  C(5)  C(2)  +  C(4)  C(3) 


(25) 


From  Fig.  8,  or  repeated  use  of  (24).  we  have  C{6)  *  6,  C(5)  =  3,  C(4)  =  2,  and  C(3)  = 
C(2)  =  C(l)  *  1,  and  hence  from  Eq.  25,  C(7)  =  11. 

For  n  =  8,  we  have 


C(8)  =  C(7)  C(l)  +  C(6)  C(2)  +  C(5)  C(3)  +  C(4)  C(4)  =  24  (26) 

The  tree  corresponding  to  n  =  8  is  shown  in  Fig.  9. 

From  the  tree  we  may  write  the  form  of  the  kernel  transform  of  each  canonic  section 
by  inspection,  using  the  product  rule  and  cascade  rule  for  system  combination  given  by 
George.**  For  example,  from  the  tree  for  the  fifth-degree  system  (Fig.  8a)  we  may  write 
the  kernel  transforms  of  each  of  the  three  different  canonic  sections  for  fifth-degree  sys¬ 
tems;  for  the  canonic  section  corresponding  to  the  uppermost  path  of  the  tree,  the  kernel 
transform  is  written  by  inspection  as 


K5(s1,s2.s2.s4,s5)  X  K3(s1,82.s3)  Kjjfs^  K^fSj)  K13(s1+s2+s3+s4+s5), 


(27) 


where  K5(Sj,s2.s3,s4.s3)  is  the  kernel  transform  of  the  corresponding  fifth-degree 
canonic  section,  K3(s1.82,s3)  is  the  kernel  transform  of  a  third-degree  canonic  section 
of  (1 1)  and  Fig.  3.  and  Kj  j(s),  K]2(s),  and  Kj3(s)  are  the  kernels  of  linear  systems. 

Thus  we  see  that  by  forming  the  tree,  and  following  each  path  in  the  tree,  we  may 
obtain  quickly  the  form  in  which  we  must  be  able  to  express  the  kernel  transform  of  an 
n^-degree  system  in  order  that  the  system  be  realizable  exactly  by  a  finite  number  of 
linear  systems  and  multipliers.  For  higher  degree  systems  the  expressions  will  not  be 
simple,  but  we  have  exhibited  a  procedure  for  obtaining  them  with  a  minimum  of  effort. 

Hence,  given  the  kernel  transform  of  an  n^-degree  system,  we  may  test  that  trans¬ 
form  to  determine  whether  or  not  it  is  realizable  exactly  with  a  finite  number  of  linear 
systems  and  multipliers. 

It  should  be  noted  that,  in  any  particular  case,  it  is  not  necessary  to  perform  the  test 
of  a  kernel  for  exact  realizability  in  one  step.  One  proceeds  by  means  of  a  sequence  of 
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simpler  tests  from  the  higher  degree  side  of  the  tree  through  the  lower  degree  branches 
as  far  as  possible.  Following  any  path  completely  through  the  tree  indicates  that  exact 
synthesis  with  linear  systems  and  multipliers  is  possible;  if  it  is  impossible  to  follow  any 
path  completely  through  the  tree  such  synthesis  is  not  possible.  Even  when  an  exact 
synthesis  is  not  found,  proceeding  as  far  as  possible  through  the  tree  reduces  the  syn¬ 
thesis  problem  from  the  synthesis  of  one  higher  degree  kernel  to  the  synthesis  of  sev¬ 
eral  lower  degree  kernels,  which  constitutes  a  significant  reduction. 

2.2  EXAMPLES 

The  procedures  discussed  above  are  illustrated  in  the  following  examples. 

Example  1 

Consider  the  kernel  transform 


H4(81'S2'S3'Vs  S4/<SJS2S3S4+2S182S3+S182VS1S3S4+S2S3V2S1S2+J!S1S3+2S2S3 

+s1s4+s2s4+s3s4+2s1+2s2+2s3+s4+2).  I 


If  this  kernel  is  to  be  realized  exactly  with  a  finite  number  of  linear  systems  and  multi¬ 
pliers,  we  must  be  able  to  express  it  in  the  form  of  (23).  To  determine  whether  this  is 
possible,  we  shall  first  try  to  express  (28)  as 


h4(8j.s2, 83,84)  «  F(s 


j,s2,s3)  G(s4)  H(Sj+s2+s3+s4) 


or  by  a  similar  expression  with  the  variables  permuted,  which  corresponds  to  one  of  the 
branches  in  the  tree  for  a  fourth-degree  system.  We  note  that  it  is  only  necessary  to 
consider  the  denominator,  which  we  will  denote  D(Sj,s2,s3>s4),  since  we  could,  if  neces¬ 
sary,  take  the  numerator  one  term  at  a  time.  We  set  the  variables  equal  to  zero  three 
at  a  time  to  obtain 


D(0,0,0,s4)  =  s4  +  2 

(29) 

D(0,0,s3>0)  =  2s3  +  2 

(30) 

D(0,s2,0,0)  =  2s2  +  2 

(31) 

D(Sj, 0,0,0)  =  2s  j  +  2. 

(32) 

Since  Eqs.  29-32  have  no  common  factor  other  than  unity,  the  only  possible  H(-)  is  unity. 
Also,  the  only  possible  G(s4)  is,  from  (29),  G(s4)  =  (s4+2).  To  see  if  this  is  indeed  a 
factor,  we  divide  D(sj,s2>s3,s4)  by  (s4+2)  to  find  that 


D(Sj,s2,s3,s4)  =  (s4+2)(s1s2s3+s1s2+sIs3+s2s3+s1+s2+s3+l).  (33) 

Now.  with  the  help  of  Eqs.  30-32,  we  recognize  the  second  factor  in  (33)  as  (Sj  +  l)(s2+l) 
(s3+l).  and  thus  have 


H4(SrS2.S3.s4)«(1-i1 


(s1  +  l)(s2  +  l)(s3+l)^ 
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Hence  this  kernel  can  be  synthesized  as  shown  in  Fig.  10. 
Example  2 

Consider  the  kernel  transform  given  by 


/j  ^  2  2  2  2  2 

(a^SjS^  4  s^s.^  4  a^SjajS,^  4  s^s^s 

4  A 


2  2  2  2 
♦  6s^*jS3s4  4  6si*2®384  4  7sis2838'»  +  7s182838** 

22  22  22  22  22 
4  2s,s„s_  4  s.s-s,.  4  2s,a„s.  4  s.s.s..  4  2s,s.s 


123  T  ’1"2"4 


12  3  T  12  4 


13  4 


2  2  2  2  2  2 

4  ^*1*3*4  4  828384  *  82*384  +  4^8182*384 

♦  128^2*3  ♦  4  10sjs2s3  4  6sJs284 

2  2  2  2 

♦  10s1*2s3  4  fis^SjS,^  4  I4s1a3s4  4  ?82*384 

♦  ®*1S3®4  ♦  8«1*3 \  4  ®a2s3s4  ♦  5s2838J 

22  22  22  22 

♦  4  2s1s4  4  ?a2s3  4  82s4  4  60si8283 


♦  36ai«2S4  4  56s1s3a4  4  35s2s3a4  4  Ss^Sj 

4  8Sj«2  4  20a*  r  12a^84  4  IOSjSj  4  68^ 

4  USjS*  4  BSjS*  4  10a^S3  4  5s2s4  4  6s3s4 
2 

4  6»384  4  48s^82  4  808^2  4  40S1S4 

2  2 

4  50s283  4  30s2s4  4  Ws-jSjj  ♦  16s1  4  8s2 
2  2 

4  12s3  4  6s4  4  648^  4  40s2  4  60a3  4  36s4  4  48) 


(35) 

Again,  we  try  to  put  the  denominator  D(Sj, s2,s3.«»4)  into  a  form  corresponding  to  the 
3  •  1  branch  of  the  fourth-degree  tree.  We  find  first 

D(0.0.0.s4)  =  36s4  4  48  a  12(3s4+4)  (36) 

D(0.0,s3.0)  a  12s*  4  60s3  4  48  a  12(s344)(s341)  (37) 

D(0.s2.0.0)  =  8s*  4  40s2  4  48  =  8{s243)(s242)  (38) 

DfSj.O.O.O)  =  16s j  4  64sj  4  48  a  16(8^3)^41)  (39) 

Examination  of  Eqs.  36-39  shows  that  no  common  factor  other  than  4  exists.  Hence  no 
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Fig.  10.  System  with  the  kernel  of  Example  1. 


factor  of  the  form  H(Sj+s2+s3+s4)  can  exist  other  than  H(-)  =  4.  We  next  attempt  to 
find  a  factor  that  is  a  function  of  only  one  of  the  variables  si*s2's3,84:  however,  division 
of  DfSj.s^SyS^)  by  each  of  (36)-{39)  shows  that  such  a  factor  cannot  exist.  We  cannot 
follow  the  3*  1  branch  of  the  tree. 

We  then  attempt  to  follow  the  2-2  branch,  or  to  express  D(sj,s2,s3>s4)  as 

D(Sj,s2,s3,s4)  *  H2(s j,s2)  K2(s3,s4)  (40) 

or  by  a  similar  expression  with  Sj,  s2>  s3>  s4  permuted;  we  have  already  found  that  no 
nontrivial  factor  of  the  form  H(Sj+s2+s3+s4)  can  be  present.  Hence  we  write 


D(0,0,s3.s4)  =  6{s3s4+s3s4+2s3+s4+7s3s4+10s3+6s4+8).  (41) 

If  a  factor  K2(s3>s4)  exists,  it  must  be  contained  in  (41).  Division  of  DfSj.Sg.Sj.s^  by 
(41)  is  successful,  yielding  a  second  factor,  and  we  have  reduced  (35)  to 


H4(8rS2,S3'S4)  = 


_ 81  +  S2 _ 

SjS2  +  SjS2  +  2Sj  +  s2  +  6SjS2  +  8s  +  8s2  +  6 


(aB4  +  s3S4  + 


2s\  +  s^  +  7s,s.  +  10s,  +  6s. 
3  4  3  4  3  4 


We  have  now  reduced  the  problem  to  synthesis  of  two  second-degree  systems.  Note 
that  at  this  point  we  are  not  yet  sure  whether  or  not  either  of  these  second-degree  sys¬ 
tems  is  exactly  realizable  with  a  finite  number  of  linear  systems  and  multipliers.  We 

may,  however,  examine  each  second-degree  system  separately,  using  the  techniques 
20 

of  Schetzen,  or  continuing  with  the  methods  used  above.  We  find  that  we  may  realize 
each  of  them,  with  the  system  whose  kernel  transform  is  given  by  (35)  then  being  syn¬ 
thesized  as  shown  in  Fig.  11. 
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Denote  the  numerator  of  this  expression  NfSj.Sg)  and  the  denominator  D(Sj.s2),  We 
observe  that  the  kernel  transform  cannot  be  put  in  the  form  (9)  unless  N(Sj»  s^),  as  well 


Fig.  11.  Realization  of  the  kernel  of  Example  2. 


as  DfSj.s^,  contains  the  factor  Setting  Sj  *  s2  *  s.  we  find  that  N(s,s)  *  0.  We 

next  attempt  to  factor  (s2~Sj)  out  of  N(Sj,  s2).  In  order  to  divide  out  this  factor,  how¬ 
ever,  we  must  expand  the  exponential  terms  in  their  Taylor's  series.  Before  doing  this, 
it  is  convenient  to  rewrite  N(Sj,s2)  as 


N(s1>s2)  s8j-  8jS2  -  Sj  e  2  -  s2  +  SjS2  +  s2  e  1 


+  sls2  e 


+  SjS2  e  -  SjSj  e  .  (44) 

Here  we  have  added  and  subtracted  SjS2  e  and  SjS2  e  .  We  may  then  write  N(8j,s2) 
as 


N(Sj.s2)  =  SjSj^-Sj)  -  s2(s2-Sj)(l-e 


)  -  SjfSg-SjMl-e 


”)  +  SjSgte 


')•  (45) 


We  note  that  (s2~Sj)  is  a  factor  of  each  of  the  first  three  terms;  in  addition  the  last 
term  is  zero  for  Sj  =  s2>  but  (s2-Sj)  cannot  be  factored  out  to  leave  a  closed-form 
expression. 

We  will  treat  each  term  separately,  writing  H2(Sj,s2)  as 
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^2^*1  '*2^  a  8  s  ”  2 

212  ®ls2  Sj 8 ^ 


“S2  '*1  “*2 

1  -  e  2  (  e  1  -  e  2 

*1*2  •l*2{82“*l) 


We  may  now  focus  attention  on  the  last  term;  of  this  term,  consider  the  factor,  which 
we  denote  F(Sj,s2), 

e"8»  _  e'S2 

Expand  the  exponentials  in  their  Taylor's  series,  to  obtain 


/  s*  s*  s*  \  /  s*  s*  sj  \ 

V  “  *1  +  IT  ~  3!  +  4!  "  *  *  7  ~  V  S2  *  21  “  31  +  4i  ~  ‘ '  7 


3  -4 


F(s1.sz)  » 


S2"S1 


Now,  although  we  cannot  write  this  in  closed  form,  and  hence  cannot  realize  H(Sj,s2) 
exactly  with  a  finite  number  of  linear  systems  and  multipliers,  we  can  approximate 
H2(s1.s2)  with  a  kernel  that  is  exactly  realizable  with  linear  systems  and  multipliers 
as  closely  as  we  wish  by  taking  as  many  terms  as  needed  of  (47).  If  we  are  only  inter¬ 
ested  in  the  low-frequency  behavior  of  the  kernel,  only  a  few  terms  may  suffice.  Thus 
we  cannot  realize  this  kernel  exactly,  but  applying  the  tests  we  have  developed  to  deter¬ 
mine  whether  or  not  the  kernel  was  exactly  realizable  with  a  finite  number  of  linear  sys¬ 
tems  and  multipliers  led  in  this  case  to  an  approximation  procedure  that  gives  very  good 
approximations  for  low  frequencies. 

The  following  points  should  be  observed  from  the  preceding  examples  and  discussion. 
First,  it  is  clear  that  the  examination  of  a  kernel  to  determine  if  it  is  exactly  realizable 
may  be  a  lengthy  and  tedious  process.  By  the  use  of  a  tree  the  labor  required  is  sys¬ 
tematized,  however.  In  addition  it  should  be  noted  that  algebraic  computation  can  always 
be  reduced  to  a  first-degree  problem,  enabling  one  to  use  the  conventional  factorization 
techniques,  although  it  may  be  convenient,  as  it  was  in  Example  3,  to  do  some  simpli¬ 
fication  at  a  higher  level  than  a  one-dimensional  problem.  Although  tedious,  the  pro¬ 
cedure  is  systematic  and  feasible,  resulting  either  in  a  realization  of  the  kernel,  the 
realization  of  as  much  of  the  kernel  as  possible,  or  the  assurance  that  nothing  can  be 
done  to  realize  the  kernel  exactly  with  a  finite  number  of  linear  systems  and  multipliers. 
We  may,  in  the  examination  of  a  kernel,  find  a  good  approximation  even  when  an  exact 
synthesis  is  not  possible;  this  is  a  fortuitous  by-product  in  some  cases. 
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y(t) 


2.  3  COMMENTS  ON  FEEDBACK  STRUCTURES 

In  Fig.  12  a  system  characterized  by  a  nonlinear  operator  H  is  connected  in  a  feed¬ 
back  configuration.  The  input  time  function  is  x(t)  and  the  output  time  function  is  y(t); 
the  function  on  which  H.  operates  is  denoted  e(t)  =  x(t)  +  y(t).  The  relation  between  x(t) 
and  y(t)  is  given  by  an  operator  G.  When  nonlinear  systems  are  connected  in  feedback 
configurations,  as  for  example  in  Fig.  12,  the  input-output  relationship  of  the  resulting 
structure  can  sometimes  be  approximated  by  a  finite  number  of  terms  of  a  Volterra 
series  expression;  it  can  never  be  represented  exactly  by  a  finite  number  of  terms.  That 
is.  even  if  the  nonlinear  operator  H  can  be  characterized  by  the  second-degree  Volterra 
kernel  alone,  so  that  y(t)  is  a  second-degree  functional  of  e{t),  it  is  still  not  possible  to 
represent  y(t)  as  a  finite-term  Volterra  functional  of  x(t). 

Thus  if  we  consider  the  kernels  of  a  family  one  at  a  time,  any  exact  synthesis  must 

rule  out  feedback  configurations;  however,  some  discussion  of  feedback  structures  is 
2 1 

pertinent.  Zames  has  tabulated  the  kernel  transforms  of  the  kernels  of  the  Volterra 
representation  of  the  operator  G.  of  the  feedback  structure  in  terms  of  the  transforms 
of  the  Volterra  kernels  of  the  nonlinear  operator  H..  The  first  few  of  these  is  given  in 
Table  1  for  convenience.  Note  that  the  relationships  are  formal  in  nature;  if  the  appro¬ 
priate  Volterra  expressions  exist,  then  the  relationships  hold,  but  special  care  must  be 
taken  to  insure  that  the  Volterra  series  for  the  feedback  structure  actually  exists,  that 
is,  converges  and  represents  the  feedback  structure  for  inputs  of  interest.  We  discuss 
only  the  formal  relationships  here,  referring  to  Zames  for  a  discussion  of  the  conver¬ 
gence  problem.  The  expressions  in  Table  1  differ  somewhat  from  those  given  by  Zames, 
since  we  have  used  positive  feedback  and  Laplace  transforms  rather  than  negative  feed¬ 
back  and  Fourier  transforms. 

From  the  expressions  of  Table  1  we  make  the  following  observations.  First,  sup¬ 
pose  that  the  nonlinear  system  within  the  loop,  that  is,  the  open-loop  relationship,  is 
realizable  exactly  by  a  finite  number  of  linear  systems  and  multipliers.  Then,  we  see 
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that  each  of  the  kernels  of  the  closed-loop  system  is  also  exactly  realizable  with  a  finite 
number  of  linear  systems  and  multipliers.  Second,  given  a  finite  family  of  kernels, 
suppose  that  we  have  found  a  realization  for  each  of  the  kernels  in  terms  of  linear  sys¬ 
tems  and  multipliers;  if  the  family  of  kernels  can  be  approximately  realized  by  a  feed¬ 
back  structure,  then  this  possibility  should  be  suggested  by  the  repetitive  nature  of  the 
Structure  for  each  of  the  kernels. 


111.  SAMPLING  IN  NONUNEAR  SYSTEMS 


Digital  operations  have  become  recognized  as  extremely  powerful  tools  in  modern 
control  and  communication  systems.  In  order  to  study  the  possibility  of  using  a  digital 
computer  effectively  in  the  study  of  a  nonlinear  system  we  must  first  understand  the 
effects  of  sampling  in  nonlinear  systems.  We  shall  now  consider  nonlinear  systems 
representable  by  a  single  term  of  a  Volterra  series,  and  examine  in  detail  the  effects 
of  sampling  operations  at  the  input  and  at  the  output. 

3. 1  IMPULSES  AND  NONUNEAR  NO-MEMORY  OPERATIONS 

In  the  system  shown  in  Fig.  13.  the  nonlinear  system  is  characterized  by  the  kernel 

4>  * 

hn(fj . r  ),  x(t)  is  the  input,  x  (t)  is  the  sampled  input,  y(t)  is  the  output,  and  y  (t) 


y*(t> 


Fig.  13.  Nonlinear  system  with  sampled  input  and  output. 


is  the  sampled  output.  The  input  and  output  samplers  operate  with  sampling  intervals 
Tj  and  T  ,  respectively. 

The  input-output  relation  for  the  nonlinear  system  is 


•  •  • 


hn<Tl 


Tn)  x*(t-Tj) . . .  **(t-Tn)  dTj. .  ,drn. 


(48) 


The  kernels  hn(fj, . . . ,  r  )  and  the  sampled  inputs  x*(t)  that  are  permissible  deserve 
close  attention.  Consider,  in  this  connection,  the  situation  in  which  a  unit  impulse  is 
applied  to  a  squarer.  Both  the  squarer  and  the  impulse  are  ideal  models  of  physical 
situations.  Both  are  useful  models,  but  together  they  constitute  an  incompatible  situation. 

Regardless  of  how  we  represent  the  impulse  as  the  limiting  behavior  of  a  sequence 
of  pulses,  and  even  though  we  do  not  look  at  the  limit  until  we  have  formed  a  sequence 
of  output  pulses  that  are  the  squares  of  the  input  pulses,  the  response  of  a  squarer  to  an 
impulse  is  infinite,  not  only  in  amplitude,  but  also  in  area. 

The  difficulty  here  is  in  the  nature  of  the  models.  The  squarer  places  emphasis  on 
the  amplitude  of  its  input;  no  other  feature  of  the  input  is  considered.  The  impulse, 
however,  places  emphasis  on  the  area  or  weight  of  a  signal.  Nonimpulsive  inputs  and 
no-memory  systems  such  as  squarers  are  compatible,  impulses  and  linear  systems  are 
compatible,  but  impulses  and  nonlinear  no-memory  systems  are  simply  not  compatible. 
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A  convenient  model  for  the  sampling  operation  is  the  "impulse- train  modulator."  The 
output  of  the  sampler  is  taken  to  be  a  sequence  of  impulses  at  the  sampling  times,  with 
the  areas  of  the  impulses  equal  to  the  amplitudes  of  the  input  at  the  sampling  instants. 
Using  this  model,  we  have 

+00 

X*(t)  *  £  x(kT)  uo(t-kT).  (49) 

k=-« 

We  note  that  in  order  for  (49)  to  be  meaningful  we  must  exclude  impulses  from  the 
input  x(t);  we  may  permit  jump  discontinuities  in  x(t). 

But,  if  this  impulsive  input  x*(t)  is  to  be  presented  to  a  nonlinear  system,  as  in 
Pig.  13,  we  must  restrict  the  kernel  hn(Tj , . . . ,  t  )  of  the  system  so  that  nonlinear 
no-memory  operations  on  the  sampled  input  are  excluded.  This  is  conveniently  accom¬ 
plished  by  requiring  that  h^-r^, . . . ,  t  )  have  no  impulsive  components. 

A  common  artifice  is  to  require  that  some  type  of  hold  circuit  follow  the  sampler,  as 

in  Fig.  14,  whenever  nonlinear  systems  are  considered.  The  hold  circuit  may  assume 

22 

any  of  several  forms,  the  cardinal  hold,  zero-order  hold,  first-order  hold,  exponential 
hold,  and  others. 


Fig.  14.  Sampler  with  hold. 


I _ _  _ _ l 


Fig.  15.  Nonlinear  system  with  hold. 

We  may  think  of  the  hold  circuit  in  cascade  with  a  nonlinear  system,  as  in  Fig.  15, 
as  a  new  nonlinear  system.  As  long  as  the  hold  is  linear,  the  cascade  combination  may 
still  be  represented  by  an  n^-degree  kernel;  moreover,  the  kernel  of  the  combination 
will  not  contain  impulsive  components. 

When  the  nonlinear  system  is  characterized  by  a  kernel  that  has  no  impulsive 
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Fig.  16.  Models  for  sampling  with  nonlinear  no- memory  systems. 

components,  that  is,  when  hn(Tj » •  •  • » Tn)  is  not  impulsive,  the  hold  circuit  is  not  essen¬ 
tial  to  a  compatible  physical  model. 

A  nonlinear  no-memory  operation  in  a  situation  in  which  we  wish  to  introduce 
sampling  may  be  modeled  as  shown  in  Fig.  16a  or  16b.  In  either  case,  y*(t)  is  the  same, 
provided  that  the  hold  circuit  repeats  the  amplitude  of  x(t)  at  the  sampling  instants;  the 
model  of  Fig.  16b  simply  avoids  sampling  before  the  nonlinear  no- memory  operation. 

3.2  SECOND-DEGREE  SYSTEMS  WITH  SAMPLED  INPUTS 

Consider  the  system  shown  in  Fig.  17.  The  system  Nj  is  a  second-degree  system 
with  the  kernel  h2(T|,  r 2).  We  exclude  kernels  having  impulsive  components.  The  input 
x(t)  is  sampled  by  an  ideal  sampler,  so  that  x*(t)  is  a  sequence  of  impulses  of  area  x(kT) 
occurring  every  T  seconds.  We  assume  that  s(t)  has  no  impulsive  components.  The 
output  y(t)  is  not  sampled. 

If  the  output  of  the  sampler  is  a  single-unit  impulse,  the  system  output  y(t) 
is  given  by 


x(t) 

J>r  **(t) 

h-(t, ,T„  ) 

r  - 

T 

y(t) 


Fig.  17.  Second-degree  system  with  sampled  input. 
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y(t)  »h2(t,t).  (50) 

Hence  the  response  to  a  unit  impulse  is  completely  determined  by  the  values  of  the  ker¬ 
nel  for  which  the  arguments  Tj  and  are  equal;  that  is,  by  the  values  over  the  line 
passing  through  the  origin  at  45*  to  each  of  the  axes,  as  shown  in  Fig.  18,  As  indicated. 


Fig.  18. 

Portion  of  the  (r  ^ ,  t2) -plane  that 

is  significant  in  the  response  to 
a  single  impulse. 

T1 


however,  the  scale  along  the  and  the  axes  is  given  by  the  time  scale;  hence  the 
scale  along  the  45*  line  is  times  the  time  scale.  Thus,  although  the  impulse 
response  is  h2(t,  t),  if  we  wish  to  interpret  the  section  of  the  surface  over  the  45*  line  as 
the  output  corresponding  to  the  impulsive  input,  then  we  must  scale  the  abscissa  values 
along  this  line  by  the  factor  1/n/7.  This  is  accomplished  conveniently  by  projecting  into 
either  the  Tj  =  0  plane  or  the  (t2=0) -plane.  To  find  the  response  to  a  unit  impulse,  then, 
we  look  in  the  (-r^r^-plane  and  project. 

Now  suppose  that  the  sampled  input  is  a  sequence  of  unit  impulses: 

«o 

x*(t)  =  £  uo<c-kT).  (51) 

k=0 

Then  the  corresponding  output  is  found  to  be 
to  to 

y(t)  Z  VHT't-kT).  (52) 

k=0  j=0 

Again,  the  response  depends  only  on  certain  values  of  the  kernel,  and  not  on  the  entire 
surface  of  the  kernel.  Observe  that  in  each  term  of  the  double  sum,  the  variation  in  each 
of  the  two  variables  is  the  same;  hence  each  term  is  given  by  the  values  of  the  kernel 
over  a  line  parallel  to  the  r ^  =  t2  line  and  intersecting  the  or  axis  at  some 
multiple  of  T  units,  as  indicated  in  Fig.  19. 

Insight  can  be  gained  by  examining  the  output  y(t)  in  (52),  term  by  term.  The  term 
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for  k  =  j  *  0  is  simply  h  ,  ft,  t) ,  the  response  to  a  unit  impulse  discussed  above.  The 
terms  for  k  =  j  =  n  are  given  by  h2(t-nT,  t-nT)  and  hence  are  the  same  as  the  k  =  j  =  0 
term,  except  shifted  nT  units  in  time.  The  situation  is  clearer  if  we  rewrite  (52)  as 

00  00 

y(t)  =  Y  h  (t-nT.  t-nT)  +  Y  h2(t-jT,t-kT)  +  Y  h2(t-jT,  t-kT).  (53) 

n=0  k>j>0  0«k<j 

At  t  =  0,  when  the  first  impulse  is  applied,  the  output  begins  just  as  if  the'system 
were  a  linear  system  with  the  unit  impulse  response  h2(t,  t);  that  is, 

y(t)  =  h2(t,t)  0  <  t  <  T.  (54) 

Now  at  t  =  T,  the  second  impulse  is  applied  and  the  output  becomes 

y(t)  =  h2(t,  t)  +  h2(t-T,  t-T)  +  h2(t,  t-T)  +  h2(t-T,  t),  T  €  t  <  2T.  (55) 

If  we  were  dealing  with  the  linear  system  characterized  by  h2(t,t),  we  would  get  the  first 
two  of  these  terms.  The  nonlinear  character  of  the  system  is  now  evident;  however,  we 


Fig.  19. 

Portion  of  the  (tj,  T2)-plane  that 

is  significant  in  the  response  to  a 
sequence  of  impulses. 


have  in  addition  the  last  two  terms.  At  time  t  =  2T,  all  of  these  terms  will  start  over, 
just  as  h2(t-T,t-T)  appeared  at  t  *  T,  and  we  shall  also  pick  up  two  more  terms,  deter¬ 
mined  by  the  next  two  45*  line  sections  of  the  kernel  of  the  system.  At  t  =  3T  we  shall 
again  find  new  components  in  the  output,  and  so  on. 

Eventually,  the  output  will  reach  a  steady-state  response.  This  steady-state  response 
will  be  the  response  to  an  input 

oo 

xj(t)  =  £  uc(t-kT).  (56) 

k=-oo 
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It  is  interesting  to  note  that,  for  the  inputs  considered,  we  can  think  of  the  output  as 
having  been  formed  by  applying  the  same  input  to  a  linear  system  constructed  as  follows: 
Project  all  the  45*  line  sections  of  ^Ti,rZ^  ^nto  the  Ti  =  T2  P*ane>  add  a^  the  curves, 
and  project  the  sum  into  the  =  0  plane.  The  resulting  function  is  the  desired  impulse 
response 

eo 

h(t)  »  h2(t,t)  +  £  [h2(t-nT,t)+h2(t.t-nT)].  (57) 

k=l 


The  response  of  this  linear  system  and  the  response  of  the  second-degree  system 
with  the  kernel  h2(Tj,r2)  will  be  identical  for  inputs  (52)  and  (56).  Note,  however,  that 
this  is  a  property  associated  with  these  specific  inputs.  If  we  change  the  inputs,  that  is, 
change  the  weights  of  the  impulses  in  the  input  sequence,  the  output  of  the  linear  system 
and  the  output  of  the  second-degree  system  will  no  longer  be  identical.  We  would  need 
to  change  the  impulse  response  of  (57)  to  follow  the  change  in  the  input  in  order  to  main¬ 
tain  identical  outputs.  Thus  we  abstract  from  the  kernel  of  the  nonlinear  system  a  linear 
system  relating  a  particular  input-output  pair. 

3.3  HIGHER  DEGREE  SYSTEMS  WITH  SAMPLED  INPUTS 

The  response  of  higher  degree  systems  to  sampled  inputs  retains  most  of  the  proper¬ 
ties  described  above  for  second-degree  systems.  A  single-unit  impulse  applied  to  a 


Fig.  20.  Portion  of  T|»T2»T3  space  that  is  significant  in 
determining  the  response  to  an  impulse. 
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third-degree  system  characterized  by  the  kernel  h3(tj,  t.>.  r$)  yields  an  output  h3(t,  t,  t). 

In  Fig.  20  the  portion  of  the  domain  of  the  kernel  cn  which  the  impulse  response  depends 

is  shown.  The  response  is  completely  determined  by  the  values  of  the  kernel  for 

Tj,  Tg,  Tj  along  the  line  through  the  origin  at  45*  to  each  of  the  axes.  The  scale  along 

this  line  is  -41  times  the  time  scale  along  each  of  the  axes. 

For  an  n^-degree  system  a  similar  situation  applies.  The  scale  factor  in  the 
th  , _ 

n  -degree  case  is  vn,  although  the  graphical  interpretation  is  not  possible. 

The  response  of  the  third-degree  system  to  a  sequence  of  impulses  Xj(t)  is  given  by 

00  00  00 

■  I  I  I  h3  (t-iT,  t-jT,  t-kT) .  (58) 

i=0  j=0  k=0 

This  sum  can  be  rearranged  to  be 
oo 

■  I  "3<*  -nT,  t-nT,  t-nT) 
n=0 

00  00 

♦»X  Xv  -nT,  t-nT,  t-(n+k)T) 
n=0  k='. 

oo  oo 

♦*Z  I  h3(t-nT,  t-(n+k)T,  t-(n+k)T) 
n=0  k=l 

00  00  00 

♦*I  2  Iv  -nT,  t-(n+k)T,  t-(n+j+k)T),  (59) 

n=0  k=l  j=l 

where  we  have  grouped  together  all  terms  in  which  all  three  arguments  are  equal,  in 
which  two  of  the  arguments  are  equal,  and  in  which  no  two  of  the  arguments  are  equal, 
and  have  assumed  a  symmetric  kernel. 

The  response  in  this  case  is  thus  completely  determined  by  the  sections  of  the  kernel 
for  which  the  arguments  lie  on  lines  at  45*  to  each  of  the  axes,  intersecting  the  planes 
T1  =  ®*  t2  =  ®*  an<*  t3  =  0  in  a  uniformly  spaced  grid  T  units  on  a  side,  over  the  positive 
quadrants  of  the  planes. 

For  0  ^  t  <  T,  the  response  is  h3(t,t,  t);  for  the  next  interval  we  have 
y(t)  =  h3(t,t.t)  +h3(t-T,t-T,t-T)  +  3h3(t,t,t-T)  +  3h3(t,t-T,t-T),  (60) 

and  again  the  nonlinearity  becomes  evident  on  application  of  the  second  impulse  of  the 
sequence.  In  subsequent  intervals  more  new  components  will  appear  in  the  output.  As 
in  the  second-degree  case,  we  can  abstract  from  the  kernel  a  linear  system  relating  this 
specific  input-output  pair.  The  impulse  response  of  this  linear  system  is  given  by 
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(61) 


00  to 

h(t)  *  h3(t,  t,  t)  +  £  h3(t,  t,  t-kT)  *  3  £  h3(t,  t-kT,  t-kT) 
k=l  k=7 

00  00 

-2  Xv.  t-kT,  t-(j+k)T). 
k=l  j=l 

In  the  general  n^-degree  case,  the  response  to  x*  (t)  is 
00  00 

y(t)  «  £  ...  £  hn(t-ijT . t-inT).  (62) 

1*0  i,=0 

n  i 

AL 

Expressions  of  the  form  of  (61)  for  the  n  -degree  case  are  extremely  complicated.  It 
is  clear,  however,  that  only  certain  slices  of  the  kernel  are  significant  in  determining 
the  response  to  a  sequence  of  impulses;  for  sampled  inputs,  only  the  "45 *  line  sections" 
are  important.  Thus  for  sampled  inputs,  kernels  that  agree  along  these  lines  are  com¬ 
pletely  equivalent. 

3.4  INPUT  AND  OUTPUT  SAMPLED 

Returning  to  the  situation  shown  in  Fig.  13,  consider  the  relation  between  the 
sampled  output  y  (t)  and  the  sampled  input  x  (t) .  The  sampled  output  is  a  sequence  of 
impulses  of  areas 

co  oo 

y<PV  1  ■■■  1  *<k1TiK..x(WVpT0-k,Ti . PV^iy.  (63) 

k  =-°°  k.=-« 

n  l 

where  xfkjTj) . x(knT^)  are  the  input  sample  values. 

We  have  observed  that  only  the  45*  line  sections  of  the  kernel  surface  are  important 
when  the  input  to  the  system  is  sampled;  from  (63)  we  see  that  only  isolated  points  on 
the  surface  of  the  kernel  are  important  in  determining  the  sampled  output.  The  remain¬ 
der  of  the  kernel  has  no  effect  on  the  sampled  output. 

Sampling  at  the  input  restricts  attention  to  the  45*  lines;  sampling  at  the  output  fur¬ 
ther  restricts  attention  to  the  points  along  the  45*  lines  at  intervals  of  T&  units. 
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IV.  SIMULATION  OF  CONTINUOUS  SYSTEMS  BY  SAMPLED  SYSTEMS 

It  is  often  convenient  to  replace  a  continuous  system  by  a  sampled  system;  for 
example,  when  a  digital  simulation  of  a  continuous  system  is  to  be  used.  We  can  take 
one  of  two  approaches:  either  we  try  to  find  a  sampled -data  system  that  performs 
exactly  the  same  operation  as  the  continuous  system  or  we  try  to  find  a  sampled -data 
system  that  approximates  the  operation  of  the  continuous  system,  with  the  approximation 
becoming  better  and  better  as  the  sampling  interval  is  made  shorter  and  shorter.  The 


y(t) 


Fig.  21.  Nonlinear  system. 

first  approach  is  useful  when  the  input  and  the  system  are  bandlimited.  If  the  system  is 
not  bandlimited,  then  we  rely  on  the  second  approach.  We  shall  discuss  the  approximation 
of  the  convolution  integral  by  a  sum  approaching  the  integral  as  the  sampling  interval  is 
decreased.  Then  we  shall  discuss  the  bandlimited  situation,  including  the  implications  of 
bandlimiting  in  nonlinear  systems,  as  well  as  modeling  and  simulation  of  these  systems. 

4.  1  APPROXIMATION  OF  THE  CONVOLUTION  INTEGRAL  BY  A  SUM 

We  consider  the  approximation  of  a  multidimensional  convolution  integral  by  a  sum¬ 
mation  approaching  the  convolution  integral  in  the  limit  of  small  sampling  intervals.  In 
Fig.  21  a  nonlinear  system  JH_ with  input  x(t)  and  output  y(t)  is  shown;  we  shall  assume 

that  H  can  be  characterized  by  a  single  kernel  h  (t, ,  . . .  ,  t  1  and  that  h  (t.,...,t  )  and 
—  n  i  n  n  l  n 

x(t)  have  no  impulsive  components.  We  wish  to  sample  the  input  and  the  output  and  find 
a  sampled -data  system  that  will  approximate  the  continuous  system  as  the  sampling  inter¬ 
val,  T,  is  decreased. 

Consider  first  the  linear  case,  n  =  1.  The  input -output  relation  is  then  given  by 

y(f)  *  J  hjfT^  x(t-Tl)  dTr  (64) 

There  are,  of  course,  many  ways  to  approximate  this  integral  by  a  sum.  We  shall  dis¬ 
cuss  a  method  closely  related  to  and  easily  modeled  by  a  sampled -data  system  and  sub¬ 
sequently  extend  this  method  of  approximation  and  model  to  higher  degree  systems. 

We  construct  an  approximation  to  hj(Tj)  as  follows.  Partition  the  abscissa,  Tj,  into 
uniform  intervals  of  length  T,  with  the  origin  falling  at  the  center  of  an  interval,  as  shown 
in  Fig.  22.  Construct  a  stepwise  approximation  to  hj(Tj),  taking  as  the  amplitude  of  each 
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Fig.  22.  Approximation  of  first-degree  kernel. 


segment  the  amplitude  of  hj(Tj)  at  the  midpoint  of  the  interval.  Now  consider  the  step¬ 
wise  approximation  to  be  a  sequence  of  pulses  of  width  T  and  height  h^kT).  Replace 
each  pulse  by  an  impulse  of  the  same  area,  occurring  at  the  midpoint  of  the  interval 
Then  we  obtain  an  approximation 


hl(Tl)  =  Z  hI(kT)  wkT>-  (65) 

k=-« 

Substituting  (65)  in  (64)  and  observing  the  output  y(t)  at  t  =  pTQ  yields 

y(PT0)  *  ^  hj(kT)  x(pTQ-kT)  T.  (66) 

k=-» 

As  T  —  0  and  TQ  —0,  we  make  the  formal  replacements 
T-drj 

kT  -Tj 

pT0-t 

and  obtain  the  convolution  integral  (64).  We  can  represent  (66)  as  shown  in  Fig.  23  with 
n  *  1.  The  amplifier  with  gain  T  is  necessary  in  order  that  the  sampled  system  approach 
the  continuous  system  as  T  is  decreased. 

For  the  second-degree  case,  n  =  2,  the  input-output  relation  of  the  continuous  system 
is 


**>  ■  If 


h2*TrT2*  x<t_Tl>  x(t_T2^  dTjdT2* 


(67) 


To  find  an  approximating  sum  for  this  integral  we  find  an  approximation  to  h_(T.  ,t_). 

fc  *  b 

Partition  both  the  Tj  and  the  r2  axes  as  described  above  in  the  linear  case;  forming  the 
Cartesian  product  of  these  partitions  yields  a  uniform  partition  of  the  plane.  Form 
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-<*>  _ _ 

T 


Fig.  23.  Approximation  of  a  continuous  system. 


a  stepwise  approximation  to  h2^TrT2^  takinS  as  amplitude  of  each  segment  the 
amplitude  h2(kjT,k2T)  at  the  midpoint  of  each  two-dimensional  interval.  Consider  this 
approximation  to  be  a  two-dimensional  sequence  of  pulses  and  replace  each  pulse  with 
an  impulse  of  the  same  area  occurring  at  the  midpoint  to  obtain  for  the  two-dimensional 
kernel 


h2<TrT2>  = 


\  h2(kjT.k2T)  UotTj-kjT)  u0(r2-k2T)  T2. 


(68) 


k2=-»  kj=-<» 

Substitution  of  (68)  in  (67)  and  observation  of  the  output  at  t  =  pTQ  yields 


y(pT, 


fc?  t? 

,)  «  2,  L  h2(k1T.k2T)x(pT0-k1T)x(pT0-k2T)T-  T. 


(69) 


k2=-«  kj=-00 


As  T  —  0  and  T  —0,  we  make  the  formal  identifications 
o 


T-dr, 


T  -dr. 


klT-Tl 


k2T  **  t2 


pTo-t 


to  obtain  the  two-dimensional  convolution  integral  (67).  We  can  represent  (69)  as  shown 

2 

in  Fig.  23  with  n  =  2.  The  amplifier,  in  this  case  having  gain  T  ,  is,  as  in  the  linear 
case,  necessary  in  order  to  secure  the  desired  limiting  behavior. 

For  the  ntk-degree  case,  the  approximation  above  extends  readily  to  give  for 
hJr 


,n|Ti,*,# 


Tn> 


+  30  +» 


„<T1 . V*  X  •••  1  VklT . knT>“<,<Tl-klT»"-VTn-knT>Tn 


k=>oo  k  ,=-« 
n  l 


and  hence  for  the  output  y(pTQ)  in  the  n^-degree  case 


(70) 
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t?  i? 

y(PTo>  -  2/  L  hn(klT knT)  x(PT0-ki'r)  •••  *(PVknT)  T"  <7l> 

|cn«-oo  kj=-oo 

which  is  represented  in  block  diagram  form  as  a  sampled -data  system  in  Fig.  23. 

Observing  the  output  at  t  *  pTQ,  we  find  that  for  these  summations  to  have  the  desired 
behavior  for  small  T,  it  is  necessary  that  the  stepwise  approximation  to  the  kernel  be 
sufficiently  accurate,  and  that  the  replacement  of  the  pulses  by  impulses  does  not  intro¬ 
duce  too  great  an  error.  Also,  TQ  must  be  small  enough  so  that  we  are  able  to  obtain 
from  the  samples  y(pTQ)  a  good  approximation  to  y(t). 

An  alternative  development  of  these  results  can  be  obtained  by  writing  (67),  or  the 
corresponding  equation  for  linear  or  higher  degree  systems,  in  the  equivalent  form 

y(t)  =  ^  ^j,^)  x<Ti)  x(t2>  dTldT2*  (72> 

which  differs  from  (67)  only  in  a  simple  change  of  variables.  We  may  now  approximate 
x(t)  in  exactly  the  manner  described  above  for  the  linear  or  first-degree  kernel,  (65)  and 
Fig.  22,  to  obtain 

00 

x(t)  =  £  Tx(t)  u^t-kT).  (73) 

k=-oo 

Substituting  (73)  in  (72)  yields  (74).  In  terms  of  Fig.  23  this  amounts  to  associating 
the  sampler  with  the  input  rather  than  with  the  system.  We  arrive  at  the  same  type  of 
approximations  on  the  input  as  described  above  for  the  kernel 

OO  00 

y(PTo>=  £  £  x(kjT)  x(k2T)  h2(pT0-k1T,pT0-k2T)  T2.  (74) 

k2=-oo  kj=-=o 

A  change  of  index  in  (74)  yields  (69)  again. 

From  the  engineer's  point  of  view,  the  length  of  the  sampling  interval  necessary  to 
achieve  an  adequate  approximation  constitutes  a  compromise  between  conflicting  require¬ 
ments.  Shortening  the  sampling  interval  requires  that  more  computations  be  carried  out 
to  obtain  each  sample  of  the  output,  and  all  of  the  computations  will  introduce  errors 
unavoidably.  The  choice  of  the  sampling  interval  is  then  a  compromise  between  approxi¬ 
mation  error  and  computation  error. 

4.  2  BANDLIMITED  SYSTEMS 

The  concept  of  bandlimiting  is  somewhat  more  complicated  in  nonlinear  than  in  linear 
systems;  we  shall  define  bandlimiting  in  linear  systems  in  such  a  way  that  the  concepts 
involved  will  carry  over  to  nonlinear  systems. 
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Fig.  24.  Nonlinear  system  with  bandlimiting  at  the  input  and  output. 


We  say  that  a  linear  system  is  bandlimited  if  the  Fourier  transform  of  the  impulse 
response  of  the  system  has  a  nonzero  magnitude  only  in  a  certain  band  or  certain  bands 
of  frequencies;  this  definition  can  be  interpreted  in  terms  of  properties  of  the  system 
as  observed  at  the  input  and  the  output  of  the  system.  Similarly,  we  may  say  that  a  sys- 

At. 

tern  characterized  as  an  n  -degree  kernel  is  bandlimited  if  the  multidimensional  Fourier 

transform  of  the  kernel  of  the  system  has  a  nonzero  magnitude  only  in  a  certain  region 

of  the  multidimensional  domain  of  definition  of  the  kernel.  This  definition  is  adequate, 

but  it  is  not  quite  as  easily  interpreted  as  the  corresponding  definition  for  linear  systems. 

To  aid  in  interpretation  of  bandlimiting  in  nonlinear  systems,  we  shall  adopt  another 

definition  that  is  equivalent  to  the  one  above,  both  for  linear  and  nonlinear  systems,  and 

which  has  obvious  interpretation  in  both  cases. 

In  this  connection,  consider  the  situation  shown  in  Fig.  24.  The  nonlinear  system  II 

is  cascaded  after  a  linear  ideal  bandlimiting  filter  Lj  and  before  a  linear  ideal  band- 

limiting  filter  L2-  The  filters  Lj  and  L2  do  not  necessarily  have  the  same  passbands. 

We  shall  denote  the  transfer  functions  of  these  filters  L.(w)  and  L-(u).  We  assume  that 

tH  *  ^ 

the  nonlinear  system  II  can  be  characterized  by  an  n  -degree  kernel  hn(Tj .  •  •  .  *Tn)»  and 
examine  the  effect  of  the  ideal  filters.  If  we  think  of  the  cascade  combination  of  the  fil¬ 
ters  L.  and  L,  with  H  as  a  new  nonlinear  system,  this  new  or  over-all  system  will  still 
be  characterized  by  an  n  -degree  kernel,  which  we  denote  gn(Tj,. . .  »Tn)-  The  multi¬ 
dimensional  Fourier  transform  of  this  kernel  is 

Gn(wj,  •  •  •  ,«n)  =  Ljtwj)  •  •  •  Li(un)  Hn(uj,  •  •  -  ,«n)  L2(uj+.  . .  +«n),  (75) 

where  Hn(«j,. . .  ,wn)  is  the  transform  of  the  kernel  hn(Tj,. . .  »Tn)* 

For  convenience,  assume  n  =  2,  and  we  may  use  the  sketches  in  Fig.  25,  in  which 
we  assume  that  Lj  and  L2  are  lowpass,  with  bandwidths  W^  and  W2,  respectively.  The 
presence  of  Lj  then  forces  to  be  nonzero  only  within  the  region  shown  in 

Fig.  25a,  while  the  presence  of  L2  limits  G2(wj,w2)  to  the  region  shown  in  Fig.  25b. 

We  then  define  a  system  as  bandlimited  from  the  input  if  precascading  an  ideal  band- 
limiting  filter  has  no  effect  on  the  over-all  performance,  and  bandlimited  at  the  output 
if  postcascading  an  ideal  bandlimiting  filter  has  no  effect  on  the  over -all  performance. 
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(a)  Bandlimiter  at  the  input. 


“2 


(b)  Bandlimiter  at  the  output. 

Fig.  25.  Effects  of  cascading  lowpass  filters  with  a  second -degree  system. 
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Since  linear  time -invariant  systems  commute,  a  linear  system  that  is  bandlimited 
at  the  input  is  also  bandlimited  at  the  output;  there  is  no  difference  in  the  two  types  of 
bandlimiting  in  this  case.  For  nonlinear  systems,  however,  the  order  of  cascading 
cannot,  in  general,  be  interchanged  without  a  corresponding  change  in  over-all  perform¬ 
ance  or  character  of  the  system,  and  it  is  then  necessary  to  make  the  above-mentioned 
distinction  between  bandlimiting  at  the  input  and  at  the  output.  Consider  again  the 
second-degree  case,  with  lowpass  limiting,  for  which  Fig.  26  applies.  In  Fig.  26,  solid 
lines  indicate  the  regions  appropriate  to  input  bandlimiting  to  (-W,W)  or  to  (-2W.2W); 
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Fig.  26.  Relation  between  input  and  output  bandlimiting. 

broken  lines  indicate  the  regions  appropriate  to  output  bandlimiting  to  (-W,W)  or  to 
(-2W.2W).  The  following  relationships  are  clear  from  the  figure;  (i)  if  postcascading 
an  ideal  filter  with  passband  (-W,  W)  has  no  effect  on  over-all  performance,  then  neither 
will  precascading  the  same  filter,  that  is,  a  lowpass  filter  at  the  output  can  be  duplicated 
at  the  input  without  changing  the  over-all  system;  (ii)  if  precascading  a  filter  with  pass- 
band  (-W,W)  has  no  effect  on  over-all  performance,  then  neither  will  postcascading  a 
lowpass  filter  with  passband  (-2W,  2W). 

These  properties  clearly  generalize  to  the  ntJl-degree  case  and  to  bandpass,  as  well 
as  lowpass,  filtering.  Thus,  if  a  system  is  characterized  by  an  n^-degrte  kernel,  we 
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have  the  following  situations:  (i)  if  the  system  is  bandlimited  at  the  output,  then  it  is 
bandlimited  at  the  input  also,  and  with  at  most  the  same  bandwidth;  (ii)  if  the  system  is 
bandlimited  at  the  input,  then  it  is  bandlimited  at  the  output  also,  but  with  at  most  n  times 
the  input  bandwidth. 

The  highest  frequency  present  in  the  output  is  at  most  n  times  the  highest  frequency 
present  in  the  input,  where  n  is  the  degree  of  the  system.  With  reference  to  Fig.  24, 

If  L2  does  not  affect  the  output  of  the  system,  then  .H  and  L2  commute. 

a.  Delay-Line  Models  for  Bandlimited  Systems 

For  nonlinear  systems  that  are  bandlimited  at  the  input,  we  may  take  advantage  of 
the  special  properties  of  systems  with  sampled  inputs  which  were  developed  in 


Section  III.  Specifically,  we  may  develop  delay-line  models  for  these  systems,  making 
use  of  the  fact  that  the  output  for  a  sampled  input  depends  only  on  the  values  of  the  ker¬ 
nels  along  certain  lines  in  the  domain  of  the  kernels. 

Consider  the  situation  shown  in  Fig.  27.  The  nonlinear  system  is  of  second  degree, 
that  is,  it  is  assumed  to  be  characterized  by  the  kernel  h^Tj,-^)  alone,  and  we  assume 
that  the  system  is  bandlimited  at  the  input  to  (-W,  W).  Now  we  consider  the  precascading 
of  an  ideal  sampler  and  an  ideal  lowpass  filter  with  passband  (-W,  W),  as  shown,  so  that 
the  lowpass  filter  has  no  effect  on  the  nonlinear  system.  For  inputs  x(t)  that  are  also 
bandlimited  to  (-W,W),  the  cascade  combination  of  the  ideal  sampler  operating  with  the 
sampling  interval  T  =  1/2W  and  the  lowpass  filter  with  bandwidth  W  has  no  net  effect. 
Thus,  under  these  conditions,  it  is  immaterial  whether  we  present  to  the  system  the 
continuous  input  x(t)  or  the  sampled  input  x*(t). 

In  Section  III  we  found  that  the  output  corresponding  to  the  sampled  input  is  given  by 


y(t)  = 


xtkjT)  x(k2T)  h2(t-k1T,t-k2T), 


(76) 


where  x(t)  is  the  input,  y(t)  the  output,  the  kernel  of  the  system,  and  T  the 

sampling  interval  of  the  input  sampler. 

Now  let  us  substitute  for  the  continuous  system  with  the  kernel  h2(Tj,T2),  which  we 
assume  to  be  symmetrical,  a  system  with  the  impulsive  kernel 
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(77) 


h2*TrT2*  *  h2<Tl*TP  Uo(TrT2)  +  2 


oo 

X  h2<TrkT-Ti>  uo<TrkT-T2>- 

k*l 


and  present  the  continuous  input  x{t)  to  this  new  system.  In  terms  of  Fig.  27,  this  is 
equivalent  to  ignoring  the  filter  Lj  and  associating  the  sampler  with  the  system  rather 
than  with  the  input.  The  output  y(t)  is  still  given  by  (76). 

The  kernel  of  (77)  can  now  be  realized  by  means  of  the  delay-line  model  of  Fig.  28, 
in  which  the  linear  systems  have  impulse  responses  given  by 


kj(t)  *  h2(t,t) 
k2(t)  =  2h2(t-T,t) 

(78) 


kN(t)  *  2h2(t-(N-l)T,t), 


y(t) 


Fig.  28.  Delay-line  model  for  second-degree  bandlimited  system. 


■  ***  ■  •- 
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and  we  assume  that  h2('*j,T2)  is  zero  outside  the  region  shown  in  Fig.  29. 

Note  that  we  have  assumed  that  the  kernel  is  exactly  bandlimited  and  essentially  time- 
limited  to  the  region  of  Fig.  29.  It  is  impossible  for  the  kernel  to  be  both  exactly  time- 
limited  and  exactly  bandlimited.  We  may  also  apply  the  results  above  to  kernels  that  are 
essentially  bandlimited  to  the  prescribed  band  and  which  are  time -limited.  Practically, 
we  shall  be  forced  to  deal  with  kernels  that  are  both  essentially  bandlimited  to  the 
prescribed  band  and  essentially  time-limited  to  the  prescribed  region  of  the  Tj,t2  plane, 
in  that  almost  all  of  the  energy  of  the  kernel  lies  within  these  regions. 

Hence  for  a  second -degree  system  that  is  essentially  bandlimited  at  the  input  and 
time -limited  to  the  region  shown  in  Fig.  29,  we  have  for  essentially  bandlimited  inputs 
the  realization  of  Fig.  28. 

Delay -line  models  for  higher-degree  bandlimited  systems  can  be  developed  similarly 
to  this  model  for  second -degree  systems.  The  complexity  increases  very  rapidly  with 


Fig.  29.  Domain  of  the  kernel  of  the  delay-line  model  for  a  bandlimited 
second -degree  system. 
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♦he  degree  of  the  system,  however.  For  a  given  number  of  taps  on  the  d^lay  line,  say 
N,  the  second-degree  model  requires  N  linear  systems.  The  third-degree  system,  as 
can  be  seen  from  Eq.  59,  would  require  that  we  form  the  product  of  the  input  with  the 
square  of  the  signal  at  each  of  the  taps  of  the  delay  line,  the  product  of  the  square  of  the 
iqput  with  each  of  the  tap  signals,  and  the  product  of  the  input  with  the  input  delayed  by 
k  units  with  the  input  delayed  by  j  units  for  k  =  1 ,  . . .  ,  N  -  1  and  j  =  k, . . . , N;  thus  the 
number  of  linear  systems  needed  in  this  case  is  2(N-1)  +  ^(N-i)  or,  on  simplification, 

l/2(N+2)(N-l).  Thus  the  complexity  grows  roughly  exponentially  with  the  degree  of  the 
system  for  a  given  number  of  taps  on  the  delay  line. 

b.  Digital  Simulation  of  Bandlimited  Systems 

In  order  to  simulate  a  system  on  a  digital  computer,  we  must  sample  both  the  input 
and  the  output  time  functions.  If  the  input  is  bandlimited  and  if  the  system  is  bandlimited 
at  the  input  and  output,  then  the  situation  shown  in  Fig.  30  is  appropriate.  We  assume 
that  H,  is  bandlimited  at  the  imput  to  (-W-.W^  and  at  the  output  to  (-WQ,Wo),  and  the 
input  x(t)  is  also  bandlimited  to  (-W^,W^).  The  output  y(t)  is  then  bandlimited  to  (~Wo>Wo). 
We  note  from  the  discussion  above  that  the  output  has  a  bandwidth  of  at  most  WQ  =  nW^, 
where  n  is  assumed  to  be  the  degree  of  the  system. 

Now,,  since  we  assume  that  Ji.  is  bandlimited  at  the  input  and  output,  we  may  omit 
Lj  and  L,  in  Fig.  30  without  changing  anything.  We  then  simulate  by  operating  on 
x*(t)  to  obtain  y  (t),  and  passing  y  (t)  through  LZg  to  reconstruct  the  continuous  output 
y(t).  The  computation  that  must  be  performed  is 

00  00 

y(pT„).  £  ...  £  *(k,T.|...  X(knr)  VpT^-T . pT0-knT.)  (79) 

k  =-*>  k,  =-70 

n  1 

for  discrete  simulation  of  the  bandlimited  n^ -degree  system.  To  the  extent  that  the 
bandlimiting  is  ideal,  this  model  performs  the  same  operation  as  the  continuous  system. 

In  the  computation  there  will  be  an  unavoidable  error,  because  of  quantization  and 
roundoff. 
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V.  TRANSFORM  ANALYSIS  OF  NONLINEAR  SAMPLED-DATA  SYSTEMS 


In  Sections  III  and  IV  we  discussed  sampling  in  nonlinear  systems  and  the  simulation 

of  continuous  systems  by  sampled-data  systems.  The  input-output  relations  for  sampled- 

data  systems  have  been  developed;  they  are  multidimensional  convolution  sums,  which 

can  be  tedious  to  evaluate  and  give  little  insight  into  system  properties.  We  shall  now 

discuss  a  multidimensional  z-transform  and  modified  z-transform  that  will  facilitate 

the  study  of  nonlinear  sampled-data  systems. 

The  use  of  the  multidimensional  z-transform  in  the  analysis  of  discrete  nonlinear 

23 

systems  has  been  examined  briefly  by  Alper. 

5.  1  MULTIDIMENSIONAL  Z -TRANSFORMS 


Definition  of  the  z-transform  and  Inverse  z-transform.  The  multidimensional 
z-transform  of  a  function  f(fj , . . .  ,Tn)  may  be  defined  as 


F(z. 


V 


(80) 


We  note  that  the  z-transform  of  a  function  depends  only  on  the  values  of  the  function  at 

uniformly  spaced  sample  points  and  not  on  the  entire  function. 

We  assume  that  f(Tj,. . .  ,rn)  has  no  impulsive  components.  If  the  summation  of  (80) 

converges  at  all,  it  will  converge  within  some  region  defined  by  <r  <  |  z^  |  «  (5^,  i  =  1 , . . .  ,  n. 

A  sufficient  but  not  a  necessary  condition  on  f(r  j , . . .  ,  rn)  such  that  its  z-transform  exist 

is  that  f(Tj, . . .  ,rn)  be  absolutely  integrable;  in  this  case,  the  region  of  convergence  will 

contain  the  multidimensional  surface  defined  by  the  Cartesian  product  r.xT-x. . .  xT  , 

i  w  n 

where  is  the  unit  circle  in  the  z^ -plane.  If  a  function  '{Tj,...  ,rn)  has  a  Laplace 
transform,  then  it  will  also  have  a  z-transform. 

The  value  of  the  function  at  the  sample  points,  f(kjT,. . .  ,  knT),  may  be  obtained  from 
the  transform  in  a  number  of  ways.  A  closed-form  expression  for  the  sample  values  in 
terms  of  the  transform  is  given  by  the  multidimensional  inversion  integral: 

ffkjT,...  ,knT)  »  (jjTj-)  <£  Z1  **•  zn”  F*zl » •  •  •  »  *„>  dzj  •  •  •  dzn»  (81) 

1  n  1 1 

where  I\  is  an  appropriate  contour  in  the  z^ -plane.  For  most  of  the  functions  considered 
here,  I".  may  be  taken  as  the  unit  circle  in  the  z. -plane.  The  sample  values  may  also 
be  obtained  as  the  coefficients  in  the  series  expansion  of  F(Zj,...  ,  zr)  in  Zj  ....  ,  z"1 
about  the  origin  in  the  z, ,  ...  ,  z  -space.  If  F(z, , . . . ,  z  )  is  expressed  as  a  ratio  of 
polynomials  in  Zj  , . . . ,  z“  ,  these  coefficients  may  be  found  by  division  of  the  numerator 
polynomial  by  the  denominator.  Examples  of  the  computation  of  the  direct  and  inverse 
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transforms  are  given  below.  A  partial  difference  equation  can  also  be  found  which  gives 
a  recursive  method  of  computing  the  sample  values  from  the  transform;  this  method  will 
be  discussed  in  Section  6.  2. 

Properties  of  the  Z-transform.  The  multidimensional  2-transform  has  some  properties 
which  make  it  useful  in  the  analysis  of  nonlinear  sampled -data  systems.  We  list  some 
of  these  properties  here;  proofs  are  given  in  Appendix  A. 

If  f(T1,...,rn)*_*.  F{zj . *n),  then 

-b,  -b 

<5.a.l)  t(r j-bjT . Tn-bnT)  _  Zj  ...  zn  ^(Zj . zn), 

where  b| ,  . . . ,  b  are  integers. 


-a  r.  -a  r 

(5.  a.  2)  e  1  *...  e  n  nf(r, 


,  alT 
F(e 


(5.  a.  3)  r if (t  . 


'Tzi  dz.  »zn)« 


l  -  1 .  . . .  n* 


If  in  addition  g(Tj,. . .  ,t  )  « — •  G(Zj,. . . ,  zn),  then  the  transform 

(5.  a.  4)  H(z j .....  z^)  =  F(z  j, . . . ,  z^)  G(z  j .....  z^) 
corresponds  to  a  function  h(Tj,. . .  ,Tn)  with  sample  values  given  by 

30  00 

h(PjT . pnT)  =  I  -  I  UkJ . knT)  g(P|T-kjT, . 

k  =-oo  k,  =  -x 

n  l 

which  is  a  multidimensional  convolution  expression. 

Example  4 


’PnT-knT> 


f<Tl»T2)  = 


1  if 


0  «  Tj  <  4 
0  «  r2  <  4 


0  otherwise 


Then,  taking  T  =  1,  we  have 
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F(z 


,.4»-  I  l  'W?' 


k2=-<«  kj=-oo 


i  i  «;ksk2  ■  i  ^  £  »;k| 


k2=0  kj-0 


k2=0  kj=0 


iia! .  i‘z24. 1 -r4 -i4 ♦  ^ 

1  -  zT1  1  -  z 


-1  •  ,  -1  -1  -1  -1  • 
1  ~  Z1  -  z2  ♦  zl  z2 


(83) 


Dividing  the  numerator  by  the  denominator,  we  find  the  finite  series  with  which  we  began 


F(Zj,z2)  =  1  +  z7*  +  z;1  +  z~lz~l  +  z72  +  z72  +  Z71*”2  +  z72z71 


1  T  ‘2  T  1  2  T  1  T  2  '  “1  2  T  *1  2 


-3  .  -3  -1  -3  ,  -3  -1  .  -2  -2  ,  -2  -3 

+  Zj  +  z2  +  Zj  z2  +  Zj  z2  +  Zj  *2  +  Zj  z2 


,  -3  -2  -3  -3 

+  *1  z2  +  Z1  Z2  ‘ 


(84) 


The  coefficients  of  this  expansion  give  the  sample  values  of  f(Tj,T2). 


Example  5 


Let 


f(Tl  »t2>  *  4 


“3t2 

e  e 


O-'-2')'  'l  a°’  T2?0 


t  j  <  0  or  r2  <  0 


(85) 


where  r  »min(TpT2).  Consider  first  the  function 


fi<TrT2>  =< 


(l-e~Zr*)  t^O,  t250 


t  j  <  0  or  t2  <  0 


(86) 


Then  we  have  for  the  z-transform,  with  sampling  interval  T, 
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—Iff  5 ggy 


00  00 


P|(*|.*2)a  Yi  Y  (1_e”2k  T)  *1  l*Z  2*  k* «  min(kltk2) 


k2=0  kjS0 


k=0 


*  n  (--2kiT)  k*. 


(87) 


0«kj<k2 


In  the  second  summation,  make  the  change  of  index  =  k2  +  k'jj  then  this  sum  becomes 

l  1  o -•**)'?'*» ?.i  >-?'  ■  i  w 


k|*l  k2=0 


kisl  v° 


The  last  sum,  on  O^kj  <k2>  can  be  treated  similarly.  We  then  have 


’  co 

r  » 

»  1 

Fl(zl»z2)  = 

I  <.-e-2kTKV2fk 

>.  *;k*  >.  *;k 

k=0 

L  k*» 

k=i  J 

(89) 


or,  evaluating  these  sums, 


l(V  Zz)  =  L  -1-1  "  -2T  -1  -1  .  -1  +  7  "  1 

[l-zj  z2  1-e  z,  z2  l-z2  J 


(1  -e~2T)  z^z"1 


(l-e“2TzJ1zJ1)(l-z;1)(l-*J1) 


(90) 


after  some  simplification.  Now  using  property  (5.  a.  2)  for  the  transform  of  fO^.r^  we 
have 


F(zr*2)  = 


,  -4T  -6T.  -1  -1 

(e  -e  )  Zj  z2 


(91) 


We  may  make  use  of  the  inversion  integral  for  the  z-transform  to  obta  n  from  F(Zj ,  z2) 
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the  value  of  any  of  the  samples  of  f(Tj,T2).  Choosing  f(T,T),  we  have 


where  we  have  evaluated  first  the  integral  on  z j.  then  the  integral  on  z^,  using  the 
Cauchy  residue  theorem,  with  T  the  unit  circle  in  each  of  the  integrations. 


5.2  MODIFIED  Z-TRANSFORMS 

The  z-transform  of  a  function  depends  only  on  the  values  of  the  function  at  uniformly 
spaced  sample  points.  Often  we  would  like  to  focus  attention  on  the  sample  points,  but 
are  nevertheless  interested  in  the  remainder  of  the  function;  in  such  cases  the  modified 
z-transform  is  useful.  The  multidimensional  modified  z-transform  of  a  function 
f (t  j  , . . .  ,rn)  may  be  defined  as 


Fm(Vmr***:Vmn)=  £ 

kn=-« 


00 

X  f[kjT-{l-nij)T ,. 


•knT-<1-mn>T]zl  * 


(93) 


where  0  «  m^  <  1,  i  =  1,  ...»  n.  Choosing  a  value  for  each  of  the  m^  amounts  to  shifting 
the  function  along  each  of  the  axes  in  its  domain  of  definition  before  taking  the 
z-transform.  Existence  of  the  transform,  that  is,  convergence  of  (82),  is  insured  under 
the  same  conditions  as  given  above  for  the  ordinary  z-transform. 

The  modified  z-transform  may  be  inverted  to  regain  the  function  f(Tj,. . .  ,rn)  by 
means  of  the  multidimensional  inversion  integral 

fftkj-l+m^T,...  ,(kn-l+mn)T]  = 


•••  £r  *n"’Fm 


where  Tj  is  an  appropriate  contour  in  the  z^ -plane. 


(Zj.mj;. . . ;  zn,mn)  dZj  . . .  dzn,  (94) 
As  for  the  inverse  z-transform  (81), 
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fj  can  be  taken  as  the  unit  circle  in  the  -plane  for  most  of  the  functions  considered 
here.  Note  that  m, ,  . . , ,  m„  are  treated  as  parameters  in  the  inversion  integral.  If 
the  modified  z-transform  •  •  5  zn,mn^ ls  exPanded  in  a  series  in  Zj  , .. . ,  z“ 

about  the  origin,  the  coefficients  of  the  expansion  will  be  functions  of  m^,  ...,  mn, 
0  <  m^  <  1,  i  *  1,  . . . ,  n,  and  will  give  the  function  f(Tj,. ..  ,Tn)  in  the  corresponding 
multidimensional  sampling  interval  in  the  (tj,.  . .  ,Tn)-space.  Examples  of  the  compu¬ 
tation  of  the  direct  and  inverse  modified  z-transform  will  be  given  below. 

Properties  of  the  Modified  z-transform.  Some  useful  properties  of  the  modified 
z-transform  are  listed  below;  proofs  are  given  in  Appendix  B. 

If  f(Tj,...,rn)- — •*  Fm<zrml;***;zn,mn)’  then 


(5.  b.  1)  f(TrblT'..-'Tn-bnT> 


”bl  "bn 

*1  W' 


where  bJt  ....  bR  are  integers.  For  shifts  not  equal  to  an  integral  num¬ 
ber  of  sampling  intervals,  we  have 


*7*  •"  ln'Fm'zrml+1-4l;-"!In’mntl-V 


f(TrAlT““*Tn‘AnT,‘ 


0  <  mj  <  A .  i  =  1 , . . . ,  n 


Fm(VmrAl;**-;zn’mn-V 


«  mi  <  1  i  =  1,. . .  ,n 


-a.T  -a  T 

( 5.  b.  2)  e  *  *  *  e  n  f(r,,...  ,rn) 


-aiT(mrl)  -anT(mn-l)  a,T  anT  . 

s  ...  e  F(e  z1,m1i...se  Vmn) 


(5.  b.  3)  TjffTj,...  ,Tn)  * — *T[(mi-l)Fm(z1,m1;...;zn,mn) 


If  in  addition  f(Tj,. . .  ,rn)  •— »  F(Zj,. .  . ,  zR),  then 


(5.  b.  4)  F(Zj , . . . ,  zn)  =  Zj  . . .  *nFm(z, ,  m; . . . ;  zn»  mR) 


m.=. . .  =m  =0 
i  n 
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For  continuous  ,Tn),  we  have  also 


F<I1 . .  .  . 


m,*. . .  =m  =1 
i  n 


Example  6 


f<Tl»T2> 


Tj  <  0  or  t2  <  0 


where  r  =  min(Tj,r2),  as  in  Example  5.  Again  consider  first  the  function 


fl<Tl'T2> 


Then  we  have 


(l-e"2T)  Tj^O,  t2 


t  |  <  0  or  r2  <  0 


00  30 


Flm,2l-ml:Vm2>5  Z  I  /,_e-2T(k  +m*-l)\  kl, 

•  M  1  A  '  “ 


V°  kj.0 


where  k  =min(kj,k2),  and  m  =  min (m j , m^).  By  making  use  of  the  same  techniques 
as  in  Example  4  (see  Appendix  B),  this  sum  can  be  written 


Flm,Il’nWm2> 


1  -  e-2T"”*-1>  -  .J1.;1(«-2T-e-2T<ra‘-,>) 


Then  use  of  property  (5.  b.  2)  for  modified  z-transforms  gives  the  desired  transform: 


_  ,  -T(m.-l)  -3T(m?-l) 

Fm  *1  ,ml*  *2,m2  =  e  * 

1  .  e-2T(m*-l)  _  z-lz-l(c-<.T-t-2Tm~  e-2T) 

'  o  — — -ST^1)  ' 


In  order  to  obtain  the  inverse,  consider  first  the  denominator  of  the  term  in  brackets 
we  may  write  this  as  a  polynomial  in  zjl  and  z“l: 


i  ,“T  “1  -3T  -1  .  .  -4T  -6T.  . -1  -1  .  -9T  -1  -2  .  -7T  -2  -I 

1  **  e  Z|  ®  e  z,^  t  (g  -e  )  Zj  ^  ®  Zj  ^  e  z,  z^ 


“1 


1  2 


1  2 


-  e 


-10T  -2  -2 
*1  *2  • 


(100) 


Dividing  this  into  unity  provides  an  expansion,  which  after  juggling  with  the  operations 

indicated  in  the  numerator  of  the  bracketed  term  in  the  transform  and  combining,  gives 

the  series  expansion  of  the  modified  z -transform  F  fz. ,  m. ; . . . ;  z  .  ml.  The  first  few 

m  11  n  n 

terms  of  this  expansion  are 


-TIPj-l)  •3TI,2'1)r„  -2T(»*-1)W  -T  -1 

r.Uj .*!>.. *  •  •  K1-*  '  —  1 

.  (,-3T.,-2T»*-T)l-l  ,  (>-2T.,-2I.‘)l-! 


♦  ...] 


(101) 

The  coefficients  of  each  term  in  this  expansion  display  the  function  f(Tj#T2)  as  a 
function  of  m^,  in  the  two-dimensional  sampling  interval  corresponding  to  that  term. 

5.3  SOME  PROPERTIES  OF  THE  TRANSFORMS  OF  CAUSAL  FUNCTIONS 

The  multidimensional  z-transform  and  the  modified  z-transform  of  functions 
f(Tj,...,r  )  which  are  "causal,"  that  is,  which  are  zero  when  any  of  the  arguments 
▼  j,  . . » ,  Tn  are  negative,  have  some  special  properties.  We  list  some  of  these  below; 
proofs  are  given  in  Appendix  C. 

Initial  and  Final  Value.  If  f(Tj ,. . .  ,Tn)  -  F(zJt. . .  ,  zn),  and  f(rj . Tn)  =  0  for  any 

of  the  Tj  less  than  zero,  then 

(5.  c.  1)  lim  f(T. , . . .  ,r  )  - — -  lim  F(z.,...,zJ,  i=l,...n. 

Tj-0  1  n  Zj-oo  1  n 

(5.C.2)  lim  f(Tj,. . .  ,Tn)  — — .  lim  (z. -1)  F(zj,, . . ,  z  ),  i=l,...n. 

T.**c©  Z.^l 

1  X 


Relation  to  Laplace  Transforms.  The  z -transform  F(Zj , ....  *n)  or  modified 

z-transform  F„(zl(m,i.,.  ;z„.nO  of  a  causal  function  f(r, , . . .  ,r  1  can  be  found 
m  l  i  n  n  ’in 

directly  from  the  Laplace  transform  F^(s  j , . . .  sn)  of  the  function  by  means  of  the  fol¬ 
lowing  integrals.  A  justification  of  the  integrals  is  given  in  Appendix  C;  an  example  of 
their  use  is  given  below. 


1  o„-j“  oA-j-  rL(V,,,»vn)dV,,dvn 

F(z.,.. .,*_)!  *  l— )"  /  *•*  J  T - ,  _ 

1  n  a.T  2*j  o  -j»  o,-j-  -TCs.-v.)  -T 

i,..  i  n  1  (I-*  1  1  )• ••(!-• 


T(«  -v  ) 
fl  n  y 


isll* • • 


(102) 


/*l*"l*’  *,;2n*"'n)  * 

_ *iT 


i*l  |«  M  |R 


®ivlT  mnvnT 

i  vJ-  v3*  rL<v— V  ***• 

z"1...*’1! - ln  J  ...  J  -  dv ,*“dvn 

1  "  2wj  V>V>  (1./T<8l“Vl))...(1^T(VVn>) 


(103) 


Frr  most  functions  considered  here  we  may  take  <r  j  =  . . .  =  <rn  =  0.  Special  care  must 
be  exercised  in  the  use  of  these  expressions  for  a  function  f(-r  j , . . .  ,  rn)  which  is  not  con¬ 
tinuous;  at  jump  discontinuities  of  f<Tj,...,r  )  these  expressions  assume  that 
f(Tj,. . .  ,rn)  is  defined  to  be  the  average  value  at  the  discontinuity. 

Example  7 

Let  ffTj.Tg)  be  the  function  whose  Laplace  transform  is 


F.  (s. .  s_)  * - 

U  1  (s1+l)(s2+3)(s1+s2+6) 


(104) 


We  may  find  the  z -transform  of  f(Tj,i"2),  with  a  sampling  interval  T,  directly  from 
(104)  as  follows. 
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and  we  have  evaluated  first  the  integral  with  respect  to  Vj,  then  the  integral  with  respect 
to  v2,  using  the  Residue  Theorem  and  closing  the  contour  of  integration  in  the  left-plane 
for  Vj  and  the  right  half-plane  for  v 2*  We  recognize  the  summation  as  the  Laplace  trans¬ 
form  of  the  sampled  version  of  the  function  whose  Laplace  transform  is  G(s).  That  is, 
if  g(t)  * — *  G(s)  and  g*(t)  is  the  sampled  version  of  g(t) 

30 

g*(t)=  ^  g(kT)uo(t-kT),  (107) 

ks-ao 

then  G*(s)  is  given  by  the  summation  in  the  expression  above  for  F(z, ,  z,).  Evaluation 

of  this  sum  at  e  =  z2  will  then  yield  the  z -transform  of  g(t).  This  z-transform  is 
readily  obtained  from  a  partial  fraction  expansion  of  G(s)  or  use  of  (104)  for  n  =  1  as 
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(108) 


,;VJT-.-ST) 


and  hence  we  have  the  desired  2 -transform 


F(Zj,z2)  = 


.  ~4T  -6T.  -1-1 

(e  -e  )  2i  *2 


(109) 


5.  4  APPLICATION  TO  NONLINEAR  SYSTEMS 

A  nonlinear  system  with  sampled  input  and  output  is  shown  in  Fig  31.  The  sampling 
interval  at  the  input  is  T^  and  that  at  the  output  is  Tq.  The  input  is  x(t)  and  the  sampled 


Fig.  31.  Nonlinear  system  with  sampled  input  and  output. 

input  is  x*(t);  the  output  is  y(t)  and  the  sampled  output  is  y*(t).  The  system  is  charac¬ 
terized  by  the  kernel  hn(Tj,. . .  .Tn).  which  we  assume  contains  no  impulsive  components. 
This  situation  was  discussed  in  Section  III,  where  the  input-output  relation  was  given  as 

JO  00 

y(pT)=£  ...  £  x(kjT)  . . .  x(knT)  hn{pT-kjT . pT-knT)  (110) 

k  =-«*>  k,=-°o 

n  1 

and  we  assume,  initially,  that  T.  =  TQ  =  T. 

Input-Output  Computation.  Although  (110)  is  not  quite  a  multidimensional  convolution 
sum  of  the  form  given  in  property  (5.  a.  4),  we  may  make  use  of  an  artifice  suggested  by 
George4'  for  continuous  systems,  introducing  the  auxiliary  function 


^(n)^lT’  *  *  *  ’  pnT^  =  X  ***  ^  x(kjT)  ...  x'knT)  hn(pjT-kjT . PnT_knT) 


from  which  the  sample  values  can  be  found: 


SI 


y<n%(p,T . pnT)  -ylpT) 

'  ’  p|**.-«pn«p 


(112) 


Using  property  (5.  a.  4),  we  find  that  the  transform  of  the  auxiliary  function  is  given  by 


*(n)^zl’*  *  * '  zn^  *  Hn<zl . zn,X*zl>  **•  X(zn)* 


(113) 


where  Hn(*j,.. .  ,*n)  is  the  multidimensional  z-transform  of  the  kernel,  and  X(z)  is  the 
one  •dimensional  z -transform  of  the  input. 

If  we  do  not  sample  the  output,  we  have  in  place  of  (111) 


ao  on 

y(n)ftl,“'  'V  =  ^  \  x<kiT)  x(knT)  hn(trklT . tn“knT>* 


(114) 


kn=-oo  kj=-oo 


Taking  the  modified  z-transform  then  gives 

Y(n)m(Irml;"-iVmn,*Hnm,2rmli-"iVmn»X<zl>  --  x<2„>- 


(115) 


Association  of  Variables.  As  shown  in  Appendix  D,  the  one -dimensional  z-transform 
of  the  output,  Y(z),  can  be  found  from  Y^(Zj , . . .  zn)  by  use  of  the  following  integral. 


Y(z)  *  (ill)  i,  <W1*2-  •  •  Wn-1>'‘  Y(n)  ^W1  • 


W2 

•  *  ^ 

W  *  *  ' 
W1 

’  wn-l  ) 

dw. . .  dw  . 
l  n-l 


(116) 


For  continuous  outputs,  the  corresponding  expression  in  terms  of  the  modified 
z-transform  is 

Ym«z'm) *  (dy)  ^  j  •••  ^  lVr'Vil'lV^ . 


*  rn-l  “rl  . \  1  -V 

•  dWj. . .  dwn_j.  (117) 

This  procedure  is  analogous  to  the  association  of  variables  given  by  George  for  the 
continuous  case,  and,  as  in  the  continuous  case,  can  be  carried  out  as  an  inspection 
technique  for  simple  functions.  The  basis  of  the  inspection  technique  is  the  replacement 


A(z  j  z^) 


-aT  -1 
■e  z. 


)(- 


e-bT,;1' 


,  .  e-(a+b)T  ,-l 


(118) 


which  is  derived  in  the  Appendix  D.  An  example  of  the  use  of  this  technique  is 
given  below. 
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Different  Sampling  Rates  at  the  Input  and  Output.  If  the  output  sampling  Interval  is  not 
equal  to  the  input  sampling  interval,  Eq.  110  becomes 

«  JO 

yipT0>  *  X  •••  1  *<klTi> •  - •  hn,pTo-klTi . "Wi'-  «ll,> 

V-*  V-” 

Let  T.  *  rTQ,  where  r  is  a  positive  integer.  Then  we  have 
00  00 

y<PTo>  =  I  •••  T  *,knrTo)  V'VV1. . PVknrTo»-  "20» 

kn~“  k,=-« 

Forming  the  auxiliary  function  y^n^(p j Tq,  . . .  ,pnTQ)  and  then  the  z-transform 
Y^jfZj . zn),  we  have 

Y,„,'zl . 2n»  •  »„<*. . *n>  X(*D  •••  *(<)■  <l21> 

Interconnections  of  Systems.  We  consider  here  the  interconnection  of  nonlinear 
sampled -data  systems  H  and  K  when  we  assume  that  the  systems  are  characterized  by 

the  Volterra  kernels  hn(Tj , . . .  ,  rn),  n  =  0,  1 . Nh,  and  kn(r  j , . . .  ,  rn),  n  *  0,  1 .... 

before  the  input  and  the  output  are  sampled.  We  will  denote  the  interconnection  of  H 


Fig.  32.  Sum  of  sampled -data  systems. 
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and  K  by  <3,  with  the  Volterra  kernels  . r^),  ns  0,1 . Ng.  before  the  input 

'  and  output  are  sampled. 

Consider  first  the  addition  of  H  and  K,  as  shown  in  Fig.  32.  It  is  clear  that  the 
systems  of  Fig.  32a  and  32b  are  equivalent.  For  G  =  H  +  J<,  then,  we  have 


*n<plT" 


..PnT)  * 


hn(plT"*‘  *pnT)  =  kn<plT' 


pnT> 


(122) 


Gn<zr 


zr)  ~  Hn(zl . V  +  Kn<zl . zr) 


(123) 


for  n  =  0, 1 . Ng  and  Ng  =  max  (Nh> NR ). 

For  the  product  of  .H  and  J{,  the  situation  is  as  shown  in  Fig.  33.  The  hold  circuits 
are  needed  in  Fig.  33a,  since  the  multiplier  is  a  nonlinear  no-memory  device  as  dis¬ 
cussed  in  Section  III.  The  systems  of  Fig.  33a  and  33h  are  clearly  equivalent.  For  G.= 
II  •  K,  then,  we  have 

«„'»1T . <>„T>  ■  1  hr<PlT . PrT>  kqlPr+.T . P„T>  <124> 

°„<*1 . *„>•!  Hr<*l . *r>Kq<Zr+l . V'  <125> 

where  the  sum  in  both  (124)  and  (125)  is  taken  over  all  pairs  of  integers  rc{o,  1, . . .  ,N^} 

and  qe{0,  I,...  ,  NR},  and  both  expressions  hold  for  n  =  0,  1,.  ..  ,Ng  with  Ng  =  NhNR. 

The  cascade  combination  of  II  following  j<  is  shown  ir.  rig.  34.  It  is  clear  that  the 

systems  of  Fig.  34a  and  Fig.  34b  are  equivalent,  while  that  of  Fig.  34c  is  not  equiva- 
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lent  to  the  others.  Following  the  procedure  used  by  Brilliant  for  the  continuous  case, 
we  have  for  the  systems  of  Fig.  34a  and  34b 


5, 


n(p*T - ,PnT)  =Z/  X  2  *"  X  hi(rlT*‘  >riT>  P  km  (••••P()T-rjT,...). 

i=0  rj=-*>  r  ^ 


(126) 


The  numbers  xm  are  formed  by  taking  all  permutations  of  i  non -negative  integers  which 
sum  to  n.  The  order  of  the  subscripts  on  the  p^  j  in  the  brackets  is  not  important.  The 
second  summation,  for  which  no  index  is  shown,  is  taken  over  all  permutations  of  i  num¬ 
bers  m-  whose  sum  is  n.  The  corresponding  kernel  transforms  are  given  by 

J 


Gn<zl' 


Zn>=Z 

i=  1 


,<rn^ 


i 

n 

j=l 


K  (. . . 

m 


z(  )>  *  •  • 


(127) 


where  a ^  is  the  product  of  arguments  of  Km  . 

J 


As  in  (126),  the  second  summation  is  over 
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Table  2.  Kernel  transforms  for  the  feedback  structure  of  Fig.  35 


w 

G.U.)  «  ■ 

1  1 


C2<*1‘*2) 


^2^Z1*Z2^ 

[i-h1(z1*2)]Ci-h1(x1)][i-h1(z2>] 


S3(*1,Z2»*3)  * 


1  1 

-"3  . . 

1-H1(z1*2z3)  n  [!„«(*.)] 
i»l  A  1 


^(*1**2  ,Z3^  ^  ^ 


HjC  ^2^*2  f  *3  ^ 


1-h1(*2z3) 


all  permutations  of  i  numbers  m^  whose  sum  is  n,  and  the  order  of  the 
important. 

For  the  values  n  =  0,1,  and  2,  assuming  hQ  =  kQ  =  0,  we  have  from  (127) 


The  same  relations  given  in  Section  II  for  a  continuous  nonlinear  system  in  the  feed¬ 
back  configuration  of  Fig.  12  hoid  for  the  sampled-data  feedback  system  of  Fig.  35, 
except  that  terms  involving  sums  of  s^  now  involve  products  of  z..  Table  2  gives  the 
z-transforms  of  thp  first  few  kernels  of  the  sampled-data  feedback  system  JG  in  Fig.  35 
in  terms  of  the  kerrel  transforms  of  the  open-loop  system  II.  We  emphasize  that,  as 
in  Section  II,  these  relations  are  formal;  they  arsume  that  the  feedback  structure  may 
be  represented  by  a  Volterra  functional  series. 

Example  8 

Consider  the  system  of  Fig.  36.  The  input  and  the  output  are  sampled  with  the 

$  ♦ 

sampling  interval  T;  x(t),  x  (t),  y(t),  and  y  (t)  are  the  input,  sampled  input,  output,  and 


Fig.  36.  Nonlinear  sampled-data  system  of  Example  8. 


sampled  output,  respectively.  The  linear  systems  Nj,  N^,  and  N^  have  the  system 
functions  shown. 

The  z -transform  of  the  kernel  of  this  system  was  computed  in  Example  5  by  using  the 
definition  of  the  z-transform,  and  again  in  Example  7  by  using  the  frequency -domain 
technique  of  (102).  It  is  given  by 
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VI.  SYNTHESIS  OF  SAMPLED-DATA  SYSTEMS 


We  shall  now  consider  methods  of  synthesis  for  sampled-data  systems.  As  in  Sec¬ 
tion  II,  we  consider  nonlinear  systems  that  can  be  represented  by  a  single  term  from 
a  Volterra  functional  series,  and  hence  are  characterized  by  a  single  Volterra  kernel, 
hn(T j . . . .  «Tn)»  We  assume  that  the  sample  values  of  the  kernel,  hn(kjT, . . .  .k^T),  and 
the  corresponding  z-transform,  Hn(Zj , . . . ,  zn>,  are  given.  The  basic  building  block 
for  the  synthesis  of  sampled-data  systems  is  the  digital  computer;  we  consider  methods 
of  computing  the  output  sample  values  y(pT)  from  the  input  sample  values  x(kT).  We  are 
concerned  only  with  computation  algorithms,  and  ignore  both  quantization  and  round-off 
error. 

First,  we  consider  direct  computation  of  the  convolution  sum,  then  we  discuss 

computation  of  the  sample  values  of  the  auxiliary  output  function  y(PjT . pnT) 

through  the  associated  partial  difference  equation,  and  finally  wc  describe  the 
decomposition  of  an  n^-degree  system  into  a  combination  of  linear  sampled-data 
systems. 

6.  1  DIRECT  COMPUTATION  OF  THE  CONVOLUTION  SUM 
th 

For  an  n  -degree  system  with  sampled  input  and  output,  the  input -output  relation 
was  found  in  Section  III  to  be 

30  30 

y(pT0)*  £  ...  y  Xk.T,)...  x(knT1)hn(pT0-k1T1 . PT0-knT,).  (132) 

V-’  kr~” 

If  we  assume  that  the  kernel  is  realizable  or  causal  and  that  the  input  is  applied  at  t  =  0, 
(132)  becomes 

a  e 

y<pT „>■  £  •••  l  x<kiTi> •  •  •  *<knTi' hn,p'r0-kiTi . »Wi>'  <153> 

kn=0  k,=0 

where  a  =  [p(T q/TJ  is  the  greatest  integer  function  in  pfT^T^).  There  are  an  te.-ms  in 
this  sum;  evaluation  of  the  sum  requires  the  computation  and  addition  of  each  of  these 
terms.  This  is  a  formidable  task  indeed  if  p  is  very  large. 

If  we  assume  that  the  kernel  is  symmetrical  and  that  only  a  finite  number  of  the 
samples  of  the  kernel  are  nonzero,  that  is,  that  the  system  has  a  finite  memory,  com¬ 
putation  of  the  sum  in  (133)  is  simplified.  But  the  amount  of  computation  required  will 
even  then  be  prohibitive  except  in  simple  cases.  Direct  computation  from  the  convolu¬ 
tion  sum,  except  in  simple  cases,  is  a  severe  problem  even  for  linear  systems;  in  the 
nonlinear  case,  the  computational  difficulty  grows  roughly  exponentially  with  the  degree 
of  the  system. 
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6.  2  COMPUTATION  FROM  THE  ASSOCIATED  PARTIAL  DIFFERENCE  EQUATION 

The  input -output  relation  for  the  transforms  of  the  input  and  output  functions  was 
found  in  Section  V  to  be 


Y#n)(Zj  *  •  •  • .  *n)  =  HJij , . . .  >  zn)  X(Zj)  ...  X(zn) , 


(»34) 


where  Y(n)(zj » •  •  •  »  zn)  is  the  z-transform  of  the  auxiliary  output  function 

WP1T . P„T>'  Hn<  Zj . zn)  is  the  z-transform  of  the  kernel  hn(kjT . knT), 

and  X(z)  is  the  z-transform  of  the  input  x{kT),  and  we  assume  that  the  input  and  output 
sampling  intervals  are  equal  and  equal  to  T. 


If  Hn(Zj . zn)  can  be  expressed  as  a  >atio  of  polynomials  in  z^' 


Hn<zl 


P(zl1 . “n1) 

Q(zj  .-•••zn  ) 


(135) 


where  P(  •)  and  Q(  •)  are  polynomials,  then  we  may  write 

q(zj  ,...  »zn  )  Y(n)<z] . zn*  =  P(zl  . zn  )  X(zl>  •“  X(zn)* 


(136) 


i 

Recognizing  from  property  5.  a.  1  that  zi  can  be  interpreted  as  a  delay  operator,  we 
may  take  the  inverse  z-transform  of  both  sides  of  (136)  to  find  a  linear  partial  differ¬ 
ence  equation  with  constant  coefficients,  which  relates  the  auxiliary  function 
y^n)(PjT,. . .  .PnT)  to  the  input  x(kT).  This  partial  difference  equation  provides  a  recur¬ 
sive  computation  algorithm  for  the  auxiliary  output  function  and  hence  for  the  output 
y(pT).  We  illustrate  this  method  with  the  following  example. 

Example  9 


H2(zj,  z2)  = 


.  -4T  -6T.  -1-1 

(6  )  Zj  z 2 


(13?) 


Then  we  have 


F,  -T  -1 

j^l-e  Zj  - 


-3T  -r  .  -4T  -6T.  -1  -1  -7T  -2  -1  -9T  -1  -2  -10T  -2  -2lv  , 

e  z2  +(e  — e  )Z|  z2  +e  Zj  z2  -te  z j  z2  — e  Zj  z2  |Yj2)zl’z2 


=  (e~4T-e‘6T)  z^z"1  X(Zj)  X(z2) 


(138) 


and  hence 
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y{PlT,p2T)  =  e"Ty[(prl)T,P;,T]  ♦  e~3Ty[PlT,  (p2-1)T]  -  (e"4T-c"tT)  y[  (p,  - 1  )T ,  (p2~  1 )  f  j 
-e“7Ty[(pr2)T.(p2-l)T]-e‘9Ty[(prl)T,(p2-2)T] 

+  e‘,0Ty[(pr2)T.(p2-2)T]  +  <e'4T-e_6T)  x[(prl)T]  x[(p2-l)Tjf 

in  which  we  have  dropped  the  subscript  on  y{PjT,p2T)  for  convenience. 

If  we  assume  that  x(0)  =  1,  and  that  all  other  input  samples  are  zero,  then  (139)  is  a 
recursive  relation  for  the  computation  of  the  inverse  z-transform  of  H2(Zj,z2),  and  thus 
we  have  arrived  at  another  method  of  inversion  for  z-transforms,  in  addition  to  those 
given  in  Section  V.  For  arbitrary  x(kT),  in  fact  even  for  random  x(kT),  since  over  any 
observation  interval  of  arbitrary  but  finite  length  we  could  conceptually  find  the  corre¬ 
sponding  z-transform,  we  have  a  recursive  computation  algorithm  for  finding  the  out¬ 
put  samples  for  a  given  sequence  of  input  samples. 

The  major  drawback  of  this  method  is  that  we  must  actually  compute  more  than  just 
the  output  samples  of  interest;  we  must  compute  the  samples  of  the  entire  auxiliary 
function.  Thus  in  Example  9,  we  must  compute  2p  samples,  which  are  not  of  interest 

1L 

as  far  as  the  output  y(pT)  is  concerned,  in  order  to  compute  the  p  n  output  sample  from 
the  (p-l)**1  output  sample. 

This  is  in  contrast  to  the  situation  for  the  linear  case,  in  which  the  corresponding 
recursive  relation  is  an  ordinary  difference  equation,  and  all  output  samples  that  must 
be  computed  are  actual  output  samples.  In  the  nonlinear  case,  we  must  compute  at  each 
step  the  value  of  samples  that  are  not  of  interest  in  order  to  get  to  the  next  sample  of 
interest. 

6.3  DECOMPOSITION  INTO  LINEAR  SAMPLED-DATA  SYSTEMS 

In  Section  II  we  developed  a  procedure  for  determining  whether  or  not  an  n^-degree 
kernel  can  be  realized  exactly  by  using  a  finite  number  of  linear  systems  and  multipliers. 
By  using  the  same  trees  and  the  rules  for  the  interconnection  of  sampled-data  systems 
which  were  given  in  Section  V  in  place  of  the  corresponding  rules  for  the  interconnection 
of  continuous  systems,  we  can  determine  from  the  kernel  transform  H  (z, .....  z  ) 
whether  or  not  an  n  -degree  sampled-data  system  can  be  decomposed  into  an  intercon¬ 
nection  of  linear  sampled-data  systems.  When  such  a  decomposition  is  possible,  we 
may  form  a  computation  algorithm  for  each  of  the  component  linear  systems  considered 
separately,  and  thus  achieve  a  composite  algorithm  for  the  computation  of  the  output 
samples  of  the  nonlinear  system  from  the  input  samples. 

Example  10 

Consider  again  the  kernel  transform  of  Example  9.  We  can  write 
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or  as 


h2(Zj,z2)  =  (e“4T-e‘6T) 


i1 


-i 


l-c-V  , 


-3T-1 


1  -  e 


-6T 


(2^2) 


(140) 


h2(V*2>  =  (e^-e-67)  Ka(Zj)  Kb(z2)  K^ZjZg),  (141) 

where  Kft(z),  Kb(z),  and  Kc(z)  are  the  systems  functions  of  linear  sampled -data  systems. 
The  equations 

u[pT]  =  e“Tu[(p-l)T]  +  x[(p-l)Tj 

v[PT]  =  e“3Tv[(p-l)T]  +  x[(p-l)T]  (M2) 

r(PT)  =  u(pT)  v(pT) 

y[pT]  =  e"6Ty[(p-l)T]  +  e’4T-e~6T)  r[pT] 

then  form  a  computation  algorithm  for  computation  of  the  output  samples  y(pT)  from  the 
input  samples  x(kT). 

Example  11 

Consider  again  the  kernel  of  Example  3. 

h2*Tl,T2*  =  (1“TrT2)  u-l<1“TrT2)  u_i(Ti>  u_i(t2>  (143) 

We  found  in  Example  3  that,  as  a  continuous  system,  this  kernel  was  not  realizable 
exactly  with  a  finite  number  of  linear  systems  and  multipliers.  It  is  of  interest  to  exam¬ 
ine  the  corresponding  sampled  kernel.  The  z-transform  of  the  kernel  (143),  if  we 
assume  a  sampling  interval  of  T,  is 
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H2(Z1'Z2)  =  H  Z  (1"klT'k2T)  u_i(1-k1T-k2T)  u.j(kjT)  u_,(k2T)  z^z^2. 


k2=-»  kj =-» 


(144) 


Make  the  change  of  index  kj  +  k2  =  k.  Then  (144)  becomes 
H2‘V*J>-X  I  (l-kT)^klzj<k'kl’ .  |  (,-kT)z-k 


k=0  kj*0 


-k. 

(z,A2)  • 


(145) 


k-0 


kj  =  0 


Now 


it, 


kj=0 


e  ~kl  s  1  ~  (VZ2> 

1  -  (z,/z2)' 


-k- 1 


(146) 
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The  remaining  sum  may  be  interpreted  as  the  sum  of  a  step,  a  negative  ramp,  and  a 
delayed  positive  ramp. 


l/T 

I 

k=0 


(l-kT)z 


-k 


-1 


-  T 


1-z-1  ‘  (1-z-1)2 


+  Tz 


-l/T  _ 2 


-1 


(1-z-1)2 


1  -  (1+T)z~*  +t"(1/T,‘1 


-1\2 
(1-z  ) 


F(z). 


Combining  these  results,  we  evaluate  (145)  as 


(147) 


H2(VZ2>  *  ,  ,  ‘  ,-l  [F(22)-<z,A2)*IF(zi)1, 

*  *  (Zj/Z2' 


(148) 


or 


H2(z,,z2)  = 


(1-zi1)2(l21-"+T>z22tTl2<1/T,'2)-(1‘I2l)2(2i‘",ltT,zi2tTli(1/T)"2) 


(•iVK-i’ft-*;1/ 


(149) 


The  factor  ^z2*-z^M  in  the  denominator  may  be  divided  out  to  give 
H2(Zj,z2) 

1  -  (ltT)(^1«-1)  ♦  ( l+2T)z j 1  z2*  .  T(z21z;,1/T)tz;(l/T,‘1-2z;<l/T|-1z21) 

0-*7,)Z(>-I,)Z 

T(z-<  'A>z-V  . .  «-2,T(  I/TH  1) 


(150) 


Examination  of  (150)  shows  that  H2(Zj,  z2)  can  be  represented  as  an  interconnection  of 
linear  sampled-data  systems,  although  this  realization  will  be  rather  complex,  par 
ticularly  for  small  T. 
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VII.  TIME -DOMAIN  SYNTHESIS  TECHNIQUE 


7.1  IMPULSE-TRAIN  TECHNIQUES  IN  LINEAR  SYSTEM  THEORY 


An  important  feature  of  the  use  of  the  convolution  or  superposition  integral  in  linear 

27 

system  theory  is  the  possibility  of  impulse-train  techniques.  The  input-output  relation 
for  a  linear  time -invariant  system  may  be  given  by  the  convolution  integral 

p+oe 

y(t)  =  \  h(r)  x(t--r)  dr,  (151) 

—00 

where  x(t)  is  the  system  input,  y(t)  is  the  output,  and  h(r)  is  the  unit  impulse  response 
or  kernel  of  the  system.  A  generalized  expression  is 


y(m+k)  (t)  _  +  h 


<m)(r)  x(k)(t-r)  dr, 


where  m  and  k  are  positive  or  negativ  3  integers,  with  f^(x)  representing  the  k**1  deriv¬ 
ative  of  f(x)  if  k  is  positive  and  the  k**1  successive  integration,  as  in  (153),  when  k  is 
negative. 


w,»  ■  f 


f(y)  dy. 


If  some  derivative  of  h(  •)  or  x(  •)  yields  only  impulses,  evaluation  of  (152)  becomes 
very  simple.  This  technique  is  useful  in  the  evaluation  of  (151),  in  finding  the  transform 
of  h(  •).  and  in  finding  approximants  to  h(  •).  and  is  thus  extremely  useful  in  the  synthesis 
of  a  linear  system  when  h(  • )  is  given. 

7.2  GENERALIZATION  OF  IMPULSE-TRAIN  TECHNIQUES  TO  NONLINEAR 
SYSTEMS 


We  shall  now  demonstrate  the  use  of  impulse -train  techniques  for  nonlinear  systems. 
Consider  a  nonlinear  system  for  which  the  input-output  relation 


p  +00  p  +00 

J  ^  *"J  -  hn<Tl . Tn)  x(t-T|) . . .  x(t-rn)  dTj  . . .  dTn 


"-00  -00 


applies,  where  x(t)  is  the  input,  y(t)  the  output,  and  h  (r^ . t  )  the  kernel  of  the  sys¬ 

tem.  This  relation  may  be  generalized  just  as  in  the  linear  case  to  give 


^  +<*  S  +°° 


-oe  ‘'-oe 


hJ^Vj . Tn)  x(k)(t-Tj)...  X(k,(t-Tn)  dr,  ...drn.  (155) 


Here  the  superscripts  x(  •)  have  the  same  significance  as  in  (152),  and  m  +  k  =  0. 
We  define 
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hnm)(Tl . Tn>  = 


0nmh_ 


. . .  0r, 


for  m  positive.  For  m  =  -1,  we  define 


hi“U(Tl . Tn*  8  I  "  *  *  *  I  !  hn(t>l . V  *>1  •  ‘  *  dV 

^■•00  —00 


For  m  any  negative  integer,  . fn)  is  found  by  repeated  application  of  (156). 

Although  (155)  is  true  for  any  n,  it  appears  to  be  most  useful  for  n  =  2,  since  we  may 
often  use  graphical  techniques  in  this  case.  Examples  of  the  use  of  (155)  for  calculation 
of  kernel  transforms  and  synthesis  of  a  given  kernel  for  second-degree  systems  are 
given  below. 


7.3  EXAMPLES  OF  THE  USE  OF  IMPULSE-TRAIN  TECHNIQUES  FOR 
SECOND-DEGREE  SYSTEMS 


Example  12 


Consider  the  second-degree  kernel  given  by 
h2(TrT2)  =  u_j(Tj)  u.jd-rj)  u_j (t^)  u_j(1-t2) 


and  sketched  in  Fig.  37a.  Form  the  partial  derivatives  with  respect  to  and  then  with 
respect  to  This  may  be  accomplished  either  graphically  or  analytically,  with  the 
following  result: 


0^7  =  luo(Tl)-Uo(1“Tl)lu-l(T2)  u-1(1“t2> 


177^7=  :o(Tl>  Uo(t21  “  W  Uo(1“t2>  +  uo°"Tl)  Uo,1“t2)  -  uo(l“Tl)  Uo(T2>' 


These  partials  are  sketched  in  Fig.  37b  and  37c.  A  type  of  singularity  which  we  shall 
call  an  "impulsive  fence"  occurs  in  the  partial  with  respect  to  Tj  (Fig.  37b). 

The  four  impulses  of  the  second  partial  can  be  realized  as  shown  in  Fig.  38a,  and 
combined  as  a  sum  to  give  the  system  of  Fig.  38b,  which  is  a  realization  of  the  second 
partial.  Simplification  yields  the  equivalent  system  shown  in  Fig.  39.  Precascadir.g 
an  ideal  integrator,  as  in  Fig.  40,  yields  a  system  which  realizes  the  original  kernel. 
Note  that  only  one  integrator  is  required,  although  two  differentiations  were  performed. 
Simplification  yields  the  system  of  Fig,  41.  Of  course,  in  this  simple  example,  we  could 
have  found  the  system  of  Fig.  41  directly  from  the  expression  for  the  kernel  (157). 

We  may  also  use  this  technique  to  obtain  the  kernel  transform,  as  in  Eqs.  159  and  160, 
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delay 

/ 

^ (T\  -  /C\ 

Fig.  40.  Realization  of  the  kernel  h2{Tj,  t 2)  of  Example  12. 


Fig.  41.  Simplified  realization  of  the  kernel  of  Example  12, 
with  k(t)  =  u_j{t)  u_j(l-t). 


since  the  transforms  of  the  components  of  the  singular  kernel  of  Fig.  37c  can  be  writ¬ 
ten  by  inspection.  Factoring  the  transform  expression  of  (160)  to  separate  variables,  we 
obtain  the  transform  expression  (161).  The  system  of  Fig.  41  is  recognizable  from  this 
form  also. 


»2h. 


®t28t1 


“*!  -s2  -s.  -s2 

1+e  1  e  -  e  1  -  e 


-8.  “B~  -S.  -S- 

1+e  e  -  e  1  -  e  2 
Bl82 


-3r 


-  e 


Example  13 

Consider  the  second-degree  system  characterized  by 
h2<Tl'T2)  *  (1-T1-T2)  u_1<1“t1“t2> 


(159) 


(160) 


(161) 


(162) 
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and  shown  in  Fig.  42a.  Partial  differentiation  of  this  kernel  yields 

»h2 

*  “  tt-l<1“TrT2>  U-1{T1>  “-l^  +  “-lN-V  U-1<T2>  uo<Tl> 

8Zh,  (163) 

8 T^~  *  “-l^l*  U-!*T2>  -  u-1(t1>  W 

-  U.jd-Tj)  U.j(t2)  uo(Tl)  +  u0(Tl)  uo(t2). 

These  partial  derivatives  are  sketched  in  Fig.  42b  and  42c. 

Let  us  find  the  transform  of  the  kernel  (162).  We  shall  look  at  the  derivative  (163), 
taking  each  term  separately  and  summing.  The  transform  of  the  second  partial  deriva¬ 
tive  is  thus 


Simplification  yields 


as  the  transform  of  the  second  p&i  tial,  and  hence  we  have 


Fig.  43.  The  kernel  of  Example  14. 


70 


71 


(164) 


H2(81*s2)  = 


»j(l  -  s2  -  e  82 


®)S2(S2’S1) 


Example  14 


Consider  the  kernel  given  by 


h2<VT2>  *  (1-|t|-t2I>  u-l‘1-|TrT2l>  u-l<Tl>  u_i<T2> 


and  shown  in  Fig.  43.  This  kernel  may  be  differentiated  as  shown  in  Fig.  44a  and  44b. 
The  transform  corresponding  to  Fig.  44b  is 


-*»  -s2 

1  -  e  1  1  -  e  i 


8l  +  82 


81  +  S2  S1  +  S2 


Simplification  and  division  by  Sj  and  s2  yields  the  kernel  transform  for  (165): 


H2(srs2)  = 


-K— -n-"*) 


S1S2(S1+S2) 


We  see  by  inspection  of  this  transform  expression  that  the  kernel  is  realizable  by  a 


Fig.  45.  Realization  of  the  kernel  of  Example  14. 


Fig.  46.  Simplified  realization  of  the  kernel  of  Example  14. 
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finite  number  of  linear  systems  and  multipliers.  An  equivalent  but  uneymmetrical  kernel 

'  c 

transform  is 


-3. 


**2^81,82^  = 


+  s,  -  1 


81  +  s2 


(168) 


This  kernel  can  be  realized  readily  with  only  one  multiplier  as  shown  in  Fig.  45  and  in 
simplified  form  in  Fig.  46. 


7.4  REMARKS 


Some  important  observations  can  be  drawn  from  these  examples.  From  the  kernel 
transforms  of  these  examples,  we  can  3ee  that  the  kernels  of  Examples  12  and  14  are  of 
the  cl--  ihul  can  he  realized  exactly  with  a  finite  number  of  linear  systems  and  multi¬ 
pliers,  while  the  kernel  of  Example  13  (considered  also  in  Example  3)  cannot  be  realized 
with  a  finite  number  of  linear  systems  and  multipliers. 

We  might  attempt  to  approximate  an  arbitrary  kernel  h2(r^,  t 2)  with  planes,  so  that 
we  could  differentiate  with  respect  to  Tj  and  t  to  obtain  a  new  function  consisting  of 
impulses  and  impulsive  fences;  if  we  could  find  a  system  that  realized  this  singular 
kernel,  then  the  original  kernel  would  be  realized  by  this  system  cascaded  after  an  ideal 
integrator.  Manipulation  of  the  resulting  system  as  in  Example  12  might  lead  to  a  quite 
simple  realization. 


7.5  REALIZATION  OF  IMPULSIVE  FENCES 


Exactly  Realizable  Impulsive  Fences.  Example  13  shows,  however,  that  not  all  impul¬ 
sive  fences  are  realizable  with  a  finite  number  of  multipliers  and  linear  systems.  In 
fact,  a  little  reflection  shows  that  the  only  impulsive  fences  that  can  be  realized  with  one 


Fig.  47.  A  system  whose  kernel  is  an  impulsive  function. 

multiplier  and  linear  systems  are  those  that  lie  along  lines  intersecting  the  Tj  or  t2  axes 
at  a  45*  angle,  or  along  lines  parallel  to  the  axes.  Such  an  impulsive  fence  is 

f(TrT2)  =  uo(tj-t2)  069) 
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which  has  the  transform 


F<V‘2  U70> 

This  is  realizable  as  shown  in  Fig.  47. 

A  unit  impulsive  fence  passing  through  the  origin  of  the  Tj,t2  plane  at  any  other 
angle  will  not  be  realizable  with  a  finite  number  of  linear  systems  and  multipliers.  For 
example, 

g(Tl»T2)  =  «0(Tj-aT2)  U^jtTj)  u_j<t2)  (171) 

has  the  transform 


C(srs2)  =  s2  +  asj  • 


Approximation  Realization  of  Impulsive  Fences.  The  impulsive  fence 


Uo(1“Tl’T2)  u-l<Tl)  u-1(t2} 


(173) 


of  Example  13  lies  perpendicular  to  the  45*  lines  and  thus  cannot  be  realized  exactly  with 
linear  systems  and  multipliers.  We  can,  however,  realize  this  impulsive  fence  approx¬ 
imately  by  means  of  an  appropriately  weighted  set  of  isolated  impulses  occurring  on  the 
same  line  in  the  ,  r2  plane. 
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Partition  the  line  Tj  +  t2  *  1  into  intervals  of  length  T  as  shown  in  Fig.  48,  so  that 
the  end  points  of  the  intervals  fall  at  the  points  (kT,  1-kT),  k  =  0, . . . ,  1/T.  At  each  of 
these  points  we  place  an  impulse  whose  area  is  equal  to  T  times  the  amplitude  of  the 
envelope  of  the  impulsive  fence  at  that  point.  Hence  we  have 


Tuo(Tj-kT)  uo(r2-l+kT) 


(174) 


as  the  proposed  approximation  to  the  impulsive  fence  of  (173).  The  transform  of  (174)  is 


-kTSj  -(l-kT)s2  -s2  y  -kT(s.-s2) 

Te  1 e  *  T  e  /e 

k=0  k=0 


(175) 


We  can  write  the  expression  on  the  right  in  (175)  in  closed  form  as 


-(s.-sJO+T) 

Te  21 ~e  -e  2 


1  -  e 


-T(srs2) 


Ks 


-(srs2)(l+T)^ 


1  -  e 


-T(3i-s2) 


(176) 


.A  . 


As  T  -•  0,  by  l'Hopital's  Hule,  we  have  the  limit 


”s2  -S1 
e _ -  e 

81  “S2 


(177) 


Thus,  to  approximate  this  impulsive  fence,  we  need  only  isolated  inpulses  along  the 
line  of  the  impulsive  fence,  weighted  according  to  the  envelope  of  the  impulsive  fence. 
Other  impulsive  fences  may  be  approximated  in  exactly  the  same  fashion. 
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VIII.  ANCILLARY  RESULTS 


8.1  TIME -INVARIANT  SYSTEMS  AND  TIME-VARIANT  SYSTEMS 

Physical  situations  can  sometimes  be  modeled  with  either  a  time -variant  system  or 
a  nonlinear  system,  according  to  the  viewpoint  one  adopts.  There  is  a  very  close  con¬ 
nection  between  time-variant  systems  and  nonlinear  time -invariant  systems,  as  we  shall 
point  out. 


y(t) 


Fig.  49.  Configuration  for  cross -term  output. 


Consider  a  second-degree  system  characterized  by  the  symmetrical  kernel  h2(Tj,  r2), 
with  input  x(t)  and  output  y(t).  The  input -output  i  clationship  is  given  by 


h2(TrT2)  X(t-Tj)  X(t-T2)  dfjdTg. 


(178) 


Consider  the  configuration  of  Fig.  49  The  three  systems  are  identical,  and  the  inputs 
and  outputs  are  combined  as  shown.  After  scaling  the  gain  by  a  factor  of  one-half,  we 
obtain  the  output 


*12^t1,t2^  Vt~rl)  x2^“t2^ 


(179) 
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Now  suppose  that  we  let  x2(t)  3  uQ(t)  and  keep  Xj{t)  arbitrary.  The  output  now 
becomes 


h2(Tj,t)  Xj(t-Tj)  drt 


(180) 


That  is.  by  application  of  a  timing  pulse  x2(t),  with  second-degree  time -invariant  sys¬ 
tems  we  have  precisely  the  situation  encountered  in  a  linear  time-variant  system.  The 
restriction  as  to  the  class  of  linear  time -variant  systems  may  be  represented  in  this 
way  or  determined  by  the  kernels  H^(t ^ ,  t2)  that  we  permit.  We  could  also  choose  the 
input  x2(t)  in  other  ways,  for  example,  an  impulse  train  or  other  periodic  signal;  we  may 
choose  to  make  x2(t)  random  in  order  to  model  a  randomly  time -variant  situation. 

We  have  assumed  in  (180)  that  the  kernel  h2^TrT2^  is  symmetrical;  however,  if  we 
are  able  to  identify  in  a  realization  of  the  second-degree  system  which  portions  are 
identified  with  and  which  with  t2,  then  the  requirement  of  symmetry  is  not  really 
necessary.  For  example,  in  Fig.  50,  if  the  upper  branch  is  identified  with  Tj  and  the 
lower  branch  with  t2>  we  may  apply  Xj(t)  and  x2(t)  as  shown  to  obtain  a  time-variant 
system  without  the  restriction  to  a  symmetrical  kernel. 


K^t) 


y(t) 


Fig.  50.  A  linear  time-variant  system. 


Thus,  if  a  time-variant  kernel  h(-r.t)  is  given,  we  can  realize  h(r^,r^)  as  a  second- 
degree  nonlinear  system  using  any  of  the  properties  or  techniques  of  the  preceding  sec¬ 
tions,  but  keeping  track  of  which  parts  of  the  realization  we  wish  to  identify  with  Tj  and 
which  with  t 2;  then  application  of  a  timing  pulse  or  signal  to  the  t2  branches  and  the 
input  x(t)  to  the  Tj  branches  yields  a  realization  of  h(r,t). 

Second-degree  time-variant  systems  may  be  obtained  from  third-degree  time- 
invariant  systems  from  the  configuration  shown  in  Fig.  51.  The  output  is  given  by 

*VT1’  t2’  t3^  x1^""t1*  x2^"t2^  x3^'"',V  dTidT2dT3‘  (181) 
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Fig.  51.  Configuration  for  cross -term  output. 


If  we  allow  Xj{t)  =  x2(t)  to  be  arbitrary,  but  make  x^(t)  =  uo(t),  we  obtain 
y(t)  =  il  l,3(Tl'T2,t>  x(t"Ti)  X<t-T2^  dTidT2’ 


(182) 


in  which  we  have  dropped  the  subscripts  on  the  input  x(t).  This  can  be  interpreted  as 
representing  a  second-degree  time-variant  system.  Other  variations  are  also  possible, 
and,  with  rapidly  increasing  complexity,  we  may  consider  higher  degree  systems  too. 

8.2  RELATION  BETWEEN  INTEGRAL  AND  DIFFERENTIAL  CHARACTERIZATIONS 
OF  NONLINEAR  SYSTEMS 


Consider  the  nonlinear  system  shown  in  block  diagram  form  in  Fig.  52.  Nj,  N2,  and 
N3  are  linear  systems,  and  N^  is  a  multiplier.  The  behavior  of  the  system  can  be 
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characterized  by  the  set  of  Eqs.  183-186. 


dz(t) 

—jjp  +  az(t)  =  x(t)  (183) 

dw(t) 

-jj-  +  bw(t)  =  x(t)  (184) 

d2y(t)  dy(t)  dr(t) 

- 2-  +  d-5r-  +  ey(t)  =  cr(t)  t-jj-  085) 

dt 

r(t)  =  w(t)  z(t),  (186) 


where  x(t)  is  the  input,  y(t)  is  the  output,  and  w(t),  z(t),  and  r(t)  are  the  inputs  and  out¬ 
put  of  the  multiplier,  as  shown  in  Pig.  52.  Equations  183-186  describe  the  behavior  of 
Nj  through  N^.  We  shall  assume  that  all  initial  conditions  are  zero. 


Fig.  52.  A  sirnde  nonlinear  system. 

We  would  like  to  find  a  differential  equation  relating  y(t)  and  x(t);  that  is,  we  would 
like  to  eliminate  w(t),  z(t),  and  r(t)  in  Eqs.  183-186.  In  order  to  do  so,  we  shall 
extend  the  domain  of  definition  from  a  line  to  a  plane,  and  look  along  the  45®  line  in  the 
plane . 

Define  r(tj,t2)  =  w(t^)  z(t2)  and  y(tj,t2)  such  that  y(t)  is  y(tj,t2)|t  _t  Substitute 

tj  for  t  in  (184)  and  t2  for  t  in  (185).  Then  multiplication  of  (183)  and  (184)  and  use  of 
the  definition  of  r(tj,t2)  yields 

82r(t.,t.)  9r(t. ,  t_)  8r(t.,t?) 

-  adtr  +  a  — at;—  +  b  ~  "at,"-  +  abr(trV  =  x(V  x(V*  <187> 

«  1  2  1 
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In  order  to  express  (1*0)  in  terms  of  £(tj,  t2)  we  must  find  an  expression  for  dy(t)/dt  in 
terms  of  p(tj,t2).  Since  p(t, t)  =  y v t) ,  the  desired  derivative  will  be  the  directional 
derivative  of  ^(tj.tg)  along  the  line  tj  -  t2,  scaled  by  the  factor  to  obtain  the  proper 
rate  of  change.  The  directional  derivative  is  given  by  the  dot  product  of  the  gradient  of 
9(  V  tg)  with  the  unit  vector  in  the  direction  of  the  45*  line.  Hence  we  have  the  corre¬ 
spondence 


ly(t)  _  „A  /  1  i  \  #<*1* 


©^(tj .  t2)  e?{trt2) 

+  et2 


Repeating  this  operation,  we  find  the  correspondence  for  the  second  derivative. 

d2y(t)  82?(tltt2)  82y(tltt2)  82y(ti,t2) 
dt2  8t2  +  2  8t28tl  +  8t2 

By  using  these  results  (186)  can  be  extended  to 


8t8  *  2  8*28*1  +  8.8 


dp  dy  -a 

+  dwl  +  dwz  +  *y  =  <*  +  irl*iq- 


We  must  now  combine  (190)  and  (187)  to  eliminate  r(tj,t2).  This  may  be  accomplished 
as  follows.  Take  the  partial  of  both  sides  of  (187)  with  respect  to  tj  to  obtain  (191),  and 
with  respect  to  t2  to  obtain  (192). 


a3?  + 

a2<> 
+  h  9  r 

dx(tj) 

v/4  \ 

8tz8ti 

a 

at2atl 

+  b  2~ 
8‘i 

+  ab  at^ 

'  dtl 

X(t2) 

d3? 

ft  ^  T  4  1 

b  »zf 

+  abJr 

dx(t) 

-  V  6 

at2ati 

&  T  1 

8t2 

8t28tj 

- 

dt2 

Also,  we  take  the  partial  of  (190)  with  respect  to  tj  to  obtain  (193),  with  respect  to  t2  to 
obtain  (194),  and  with  respect  to  tj  and  t2  to  obtain  (195). 


-3/s 

8  y 

a3y 

83y 

▲  A 

»zy 

— x  A 

3  tz 

8ti 

8t28t2 

aij8tl 

T  U 

2  +  d 
8tl 

-3/s 

8  y 

A  3a 

8  y 

«3y 

X  /I 

8Zy 

Vi 

8<28«1 

+  3 
8t2 

T  a 

8t28tl  4 

3t29tl  8tl  8tl  8tl  8t28tl 


a.8  *  ’  8'2 


__8r  +  8  r  .  O 

8t2  8t28tl  at2 


3  +  2  g  2  +  3  ^d 

8t28tj  at2atj  atptj 


- 2  +  d  2 -  *  e 

8t28tl  8t28tl 


8  ?  ,  a2?  ,  a3?  ,  83? 

8t28tl  8t28tl  at28t2  8t28tj 
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Next,  multiply  through  (187)  by  c,  and  add  the  resulting  equation  to  (191)  plus  (192). 
Multiply  through  (194)  by  a,  (193)  by  b,  and  (190)  by  ab,  and  add  the  sum  of  these  new 
equations  to  (195).  We  then  can  write 

dx(t.)  dx(t.) 

cx(tj)  x(t2)  +  x(tj)  +  jjt.  = 


a3j  «3a  »2a  a 

+  (a+b+c)  +  b  +  a  — y  +  (ab+bc)  -g —  +  (ab+ac)-§~-  +  abcr 


8tS8tl  8t28il 


2  1 


8t: 


at: 


«4a 
0  y 


q4a 
8  y 


_3a 
d  y 


_3a 

®  y 


„3a 

»  y 


-  +  2  —5—5  +  — ; - +  (a+2b+d) - ?  +  (2a+b+d)  — 5 - +  b  — s- 

8t28ti  at 2 at j  at|atl  at2at“  atzati  atj 


or 


83a 

y 


8  29 


+  a  — 5-  +  (ad+2ab+ba-t-e) 

bt\  8t28tl 


82? 


829 


+  (ab+bd)  — r~  +  (ab+ad)  — « 


at 


at: 


-A 

ay 


,A 

ay 


+  (abd+be)  -rr-  +  (abd+ae)  -57-  +  abey 

at,  at2 


a4? 

a,2a.J 


+  2 


84y 


_4a 

a  y 


83y 


>39 


„3a 

8  y 


8t23ll  8*28<1 


+  (a+2b+d)  — ■ - r  +  (2a+b+d)  — ~ —  +  b  ~-r- 

8t28t2  at^atj  atj 


n3  A 

8  y 


a2a 

a  y 


82y 


q2a 

3  y 


+  a  — 5*  +  (ad+2ab+bd+e)  vr  "j..-  +  (ab+bd)  — 5-  +  (ab+ad)  — -r 


at 


‘2**1 


at: 


at: 


®y 


8y 


+  (abd+be)  +  (abd+ae)-^— +  abey 
1  2 


dx(t2)  dx(tj) 


CX(tj)  x(t2)  +  x(tj)  +  dt^  x^2)' 


(196) 


We  have  thus  obtained  a  single  differential  equation  relating  y(t)  and  x(t).  The  equa¬ 
tion  is  a  linear  partial  differential  equation  with  constant  coefficients. 

This  linear  partial  differential  equation  is  particularly  well  suited  to  solution  by 
means  of  the  two-dimensional  Laplace  transform.  Taking  the  transform  of  each  side, 
we  find 

^SjSjj+ZSjS^+s  j82+(a+2btd)s  2s2+(2a+b+d)s  jS2+bs  j+as2+(ad+2ab+bd+e)SjS2 

+(ab+bd)s2+(ab+ad)s2+(abd+be)  s  j +(abd+ae)  s2+abe (s  j ,  s2) 

=  (Sj+s2+c)  X(Sj)  X(s2). 
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Factoring  the  polynomials  in  this  expression  and  solving  for  Yfs^,  s2),  we  have 


${slts2)  = 


+  s2  +  c 


(Sj+b){s2+a)  (Sj+s2)  +d(s 


j+s2)+e] 


X(Sl)  X(s2). 


We  now  note  that 


H2(srs2)  £ 


Sj  ♦  s2  +  c 


(s1+b)(s2+a)^(s1+s2)2+d(s1+s2)+ej 


is  the  transform  of  the  Vclterra  kernel,  h2(Tj,  r2),  of  the  system  of  Fig.  1  when  the  sys¬ 
tem  is  characterized  by  the  integral  equation 

y(t)  =  h2(TrT2)  x<t_T2 )  dTidT2#  098) 

In  fact,  taking  the  inverse  transform  of  (197)  we  have 

=  JT  h2*Tl'  T2*  x(t2"T2^  dTldT2 


from  which  (198)  follows  by  setting  tj  =  t2  =  t. 

From  this  example  the  following  observations  may  be  made. 

1.  Given  a  system  of  equations  that  are  the  dynamic  description  of  a  nonlinear  sys¬ 
tem,  by  extending  the  domain  of  definition  from  one  dimension  to  two  dimensions,  we 
were  able  to  find  a  single  linear  partial  differential  equation  that  also  characterizes  the 
system.  That  is,  by  extending  from  one  dimension  into  two  dimensions,  a  one¬ 
dimensional  nonlinear  problem  was  converted  into  a  two-dimensional  linear  problem. 

2.  Equations  183-186  and  Eq.  198  describe  the  same  situation.  A  system  that  is 
characterized  by  a  single  integral  equation  is  equivalently  described  by  a  set  r»f  several 
ordinary  differential  equations  and  a  nondifferential  equation.  A  description  by  one  non¬ 
linear  ordinary  differential  equation  does  not  seem  to  be  possible. 

3.  Whenever  a  system  is  characterized  by  an  n^-degree  Volterra  kernel  having  a 
rational  transform,  a  linear  partial  differential  equation  with  constant  coefficients  can 
be  found  which  relates  the  auxiliary  output  function  y(tj, . . . ,  tn)  to  the  input  function  x(t). 
If  the  kernel  is  of  the  class  that  can  be  realized  exactly  with  a  finite  number  of  linear 
systems  and  multipliers,  then  an  equivalent  description  by  a  set  of  ordinary  differential 
equations  and  nondifferential  equations  can  be  found. 

Although  the  example  and  observations  presented  here  have  no1,  yet  led  to  the  solution 
of  any  problems  that  cannot  be  easily  handled  by  other  methods,  it  is  felt  that  the  view¬ 
point  presented  is  unique  and  may  lead  to  a  deeper  understanding  of  the  properties  of 
nonlinear  systems. 
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IX.  CONCLUSION 


We  have  studied  some  techniques  for  the  synthesis  of  nonlinear  systems.  The  sys¬ 
tems  considered  are  those  that  can  be  characterized  by  a  finite  set  of  Volterra  kernels: 

{hn<Tj, . . . ,  tr):  n=  0, 1, 2 . N}.  The  approach  adopted  throughout  has  been  to  consider 

the  kernels  one  at  a  time,  using  as  basic  elements  it.  the  synthesis  linear  systems  and 
multipliers. 

We  have  presented  a  procedure  for  testing  a  given  kernel  transform  to  determine 
whether  or  not  the  kernel  can  be  realized  exactly  with  a  finite  number  of  linear  systems 
and  multipliers.  The  test  is  constructive.  If  it  is  possible  to  realize  the  kernel  exactly, 
a  realization  is  given  by  the  test;  if  it  is  not  possible  to  realize  the  complete  kernel 
exactly,  but  it  is  possible  to  break  the  kernel  up  into  several  lower  degree  components, 
this  will  also  be  discovered  by  the  test. 

An  extension  to  nonlinear  systems  of  the  impulse-train  techniques  of  linear  system 
theory  is  given.  Although  applicable  in  principle  to  higher  degree  systems,  the  use  of 
impulse-train  techniques  as  graphical  methods  is  effectively  limited  to  second-degree 
systems. 

The  use  of  digital  systems  is  recognized  as  a  powerful  tool  in  modern  system  theory. 
We  have  developed  properties  of  sampling  in  nonlinear  systems,  in  order  to  facilitate 
the  use  of  digital  techniques  in  the  synthesis  of  nonlinear  systems.  Bandlimiting  in  non¬ 
linear  systems  is  discussed,  and  delay  line  models  for  bandlimited  systems  are  given. 

The  transform  analysis  of  nonlinear  sampled-data  systems  by  means  of  the  multi¬ 
dimensional  z-transform  is  presented.  Computation  algorithms  for  input-output  com¬ 
putations  are  given  for  direct  computation  from  the  multidimensional  convolution  sum, 
from  the  associated  partial  difference  equation,  and  from  a  decomposition  of  the  non¬ 
linear  sampled-data  system  into  linear  sampled-data  systems. 

A  relationship  between  time-variant  and  time-invariant  systems  is  presented,  in 
which  time-variant  systems  are  shown  to  be  related  to  time-invariant  systems  of  higher 
degree.  This  enables  one  to  use  for  linear  time-variant  systems  the  properties  and 
techniques  developed  for  second-degree  time-invariant  systems. 

A  note  on  the  multidimensional  formulation  of  nonlinear  systems  from  the  differential 
equation  point  of  view  is  given;  it  is  seen  that  some  nonlinear  problems  in  one  dimension 
can  be  mapped  into  a  linear  problem  in  a  higher  dimensional  space. 

As  with  linear  systems,  the  prob’em  of  the  synthesis  of  a  nonlinear  system  is  the 
problem  of  finding  a  finite-dimensional  state  space  in  which  the  system  may  be 
described.  One  expects  that  an  attack  on  the  problem  directly  from  the  state  space  point 
of  view  may  be  fruitful. 
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appendix  a 


Proofs  of  the  properties  of  z-transforms  given  in  Chapter  V  are  given  below. 
A.  I  Proof  of  S.  a  1 
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,  4  Proof  of  5.  a.  4 
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APPENDIX  B 


Proof,  of  the  properties  of  modified  z-trsnsforms  given  in  Section  V,  and  the  details 
of  Example  6  are  presented  here. 

B.  1  Proof  of  S.  b.  1 
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For  shifts  equal  to  an  integral  multiple  of  T,  the  proof  of  this  property  is  the 
that  given  above  for  the  ordinary  z -transform. 

B.  2  Proof  of  5.  b.  2 
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B.3  Proof  of  5.  b.  3 
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B.  4  Proof  of  5.  b.  4 
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APPENDIX  C 


Proofs  of  properties  of  the  transforms  of  causal  functions  in  Section  5. 3  are  given 
low. 

1  Proof  of  5.  c.  1 
For  causal  f (t  ^ . Tft)  we  have 
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A  similar  relation  holds  for  i  =  2, . . .  ,n. 


C.  3  Proof  of  Eqs.  (84)  and  (85) 


We  prove  only  Eq.  85  from  which  (84)  follows  also  by  5.b.  4. 
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vhere  ®  denotes  multidimensional  complex  convolution.  This  is  the  expression  given 

explicitly  in  (85).  We  note  that  in  this  expression,  because  of  the  nature  of  the  Laplace 

24 

nversion  integral,  it  is  assumed  that  f (r^ , . . . ,  t  )  is  defined  as  the  average  value  at 
ump  discontinuities. 
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APPENDIX  D 


Equations  stated  in  Section  V  without  proof  are  justified  below. 

D.  1  Proof  of  Eqs.  116  and  117 

We  shall  prove  (116)  for  n=  2.  The  extension  to  the  higher  dimensional  case  is  clear 

^(2)^T»kT)  *  9r  *1  ll21Wl’!2,dzldV 

*1  *2 

Let  z  a  then  dz  =  z\  dz2  and 
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and  hence 

For  the  modified  z -transform  (117),  we  have 
,(!)[|krUm1IT^-1«2ITl^-J-)!^r  *,*  ’*22  1Y(2)m(^.n.1iJ2.m2)d,1dz2. 
Setting  kj  =  k£  =  k  and  mj  =  m2  =  m  yields 

y[(k-m+l)T]  =  ^  ^  *2.m)  d*^. 

From  this  point  the  proof  follows  that  above  for  the  z -transform,  and  (118)  follows  for 
n  a  2.  The  extension  to  higher  dimensions  is  clear. 

D.  2  Derivation  of  Eq.  118 
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•a  abstract  Some  techniques  for  the  synthesis  of  nonlinear  systems  that  can  be 
characterized  by  a  finite  set  of  Volterra  kernels  are  studied.  The  kernels  are 
considered  one  at  a  time,  by  using  as  basic  elements  in  the  synthesis  linear  systems 
and  multipliers.  We  present  a  procedure  for  constructively  testing  a  given  kernel 
transform  to  determine  whether  the  kernel  can  be  realized  exactly  with  a  finite 
number  of  linear  systems  and  multipliers.  If  it  is  possible  to  realize  the  kernel 
exactly,  a  realization  is  given  by  the  test;  if  it  is  not,  but  is  possible  to  break  the 
kernel  up  into  several  lower  degree  components,  this  will  be  discovered  by  the  test. 
An  extension  to  nonlinear  systems  of  the  impulse- train  techniques  of  linear  sys¬ 
tem  theory  is  given.  We  develop  properties  of  sampling  in  nonlinear  systems,  to 
facilitate  the  U3e  of  digital  techniques  in  the  synthesis  of  nonlinear  systems.  Band- 
limiting  nonlinear  systems  and  delay-line  models  for  bandlimited  systems  are 
discussed.  Transform  analysis  of  nonlinear  sampled- data  systems  by  the  multi¬ 
dimensional  z-transform  is  presented.  Computation  algorithms  for  input-output 
computations  are  given  for  direct  computation  from  the  multidimensional  convo¬ 
lution  sum,  the  associated  partial- difference  equation,  and  a  decomposition  of  the 
nonlinear  sampled-data  system  into  linear  sampled- data  systems.  A  relationship 
between  time-variant  and  time- invariant  systems  is  shown,  in  which  time-variant 
systems  are  shown  to  be  related  to  systems  of  higher  degree,  which  enables  the  use 
for  linear  time- variant  systems  of  the  properties  and  techniques  developed  for 
second-degree  systems.  Multidimensional  formulation  of  nonlinear  systems  from 
the  differential  equation  point  of  view  is  noted;  some  nonlinear  problems  in  one 
dimension  can  be  mapped  into  a  linear  problem  in  a  higher  dimensional  space. 
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